Doesn't seem to do actual summarization

#78
by johnblues - opened

Maybe I'm misunderstanding these summarization models. This models and the others I've tried do the same thing, they re-use a few sentences and snippets from the input text. They don't rewrite the text is a more concise way. Are there models that do that?

I had the same experience.

Yep, same here. Useless excerpts from the text.

This is how non-llm models work. You likely will not find a very good summarization model without using an LLM.

In my opinion, it still does a decent job at basic summarization:

Input: Apple also unveiled new Watches and AirPods with health-focused capabilities, as well as hardware-design improvements. Apple highlighted the Watch's ability to discover longer-term health conditions such as sleep apnea as well as detecting and responding to emergencies such as a fall.
As it updated AirPods, Apple rolled out hearing-aid features that it has submitted for U.S. regulatory review.
Apple fans globally have been waiting to see the new phones with AI. IPhones accounted for more than half of Apple's $383 billion sales last year.
"While most of the features will start in the U.S., they will also help Apple stay competitive against fast-moving competitors in China," said D.A. Davidson analyst Gil Luria. "While Android phones may have some of these features, Apple has packaged them well and will be able to market them far more broadly."
Apple Intelligence must be approved by Beijing in order to be released in China. In July, OpenAI blocked access to ChatGPT in China, and Apple has not announced an AI partner for China.
"Apple fell out of the list of top five smartphone vendors in China in Q2," said eMarketer senior technology analyst Gadjo Sevilla. "It was the first time that China's domestic smartphone firms held all five spots. Since Apple Intelligence still needs to be approved by Beijing for a rollout in China, it will likely not initially be a key driver for adoption in the region."
In China, Apple aggressively slashed prices earlier this year, prompted by government restrictions and increased domestic competition.
The iPhone 16 lineup is the first Apple smartphones designed around these AI features though those are expected also to be available on iPhone 15 Pro and Pro Max, the top-end versions of the previous-generation devices.
Rivals including Alphabet's (GOOGL.O), opens new tab Google are also showcasing AI features to try to upend Apple's dominance in the high-end smartphone market.
Google, developer of the Android operating system which competes with Apple's iOS, focused its Pixel smartphone rollout event in August on AI features including Gemini Live, which allows users to hold live voice conversations with a digital assistant. Many of the AI features Google announced were also rolled out to the Android-based devices made by manufacturers such as Samsung (005930.KS), opens new tab and Motorola (MSI.N), opens new tab.
In June, one week after its developer conference, Apple said it would delay the release of AI-powerd features in Europe due to European Union tech rules.
Huawei has scheduled an official announcement of its Mate XT phone on Tuesday in China.

Output: The iPhone 16 lineup is the first Apple smartphones designed around these AI features. Apple also unveiled new Watches and AirPods with health-focused capabilities, as well as hardware-design improvements. Apple Intelligence must be approved by Beijing in order to be released in China. Apple has not announced an AI partner for China.

For a better summarizer that does a really decent job, check out this model in my space -

https://huggingface.co/spaces/Amitontheweb/Neat_Summarization_Model

Sign up or log in to comment