Automatic Summarization

Posted by

Understands the meaning of a text by reading only the key sentences. 

This version uses TF and TF-IDF (term frequency–inverse document frequency) numerical statistics that show how important a word or a combination of words is for a document. Using this approach, each and every sentence and phrase of a document is given a weight and the summarization algorithm takes these into consideration.

This approach allows the Summarizer XT IntelliDocker to handle a plethora of types of documents. The set of supported languages is extended, as well.

Supported Languages

Currently supporting the following languages (15): Arabic (ara), Danish (dan), Dutch (nld), English (eng), Finnish (fin), French (fra), German (deu), Hungarian (hun), Italian (ita), Norwegian (nor), Portuguese (por), Romanian (ron), Russian (rus), Spanish (spa), Swedish (swe).

NOTE: When using the engine, please make sure you provide the correct language of the text to be processed, since this is crucial information for the summarizer so that it can correctly split sentences / phrases and so that it can handle words and word frequencies the right way.

Usage Example

if you want to specify the size of the output summary you need to use the “language” parameter in the following way:

{ 
"content": "Lorem ipsum",
  	"language": "-l eng -s 20"
}

or

{ 	
"content": "Lorem ipsum",
  	"language": "--language eng --size 20"
}

NOTE: If the “language” parameter is not specified, the Summarizer XT will consider the language to be “english”. If the size is not specified, the implicit size is set to 10%.

This is an example of calling the Summarizer XT on an English text specifying the size of the output to be of 15% using curl:

curl -X POST "http://localhost:8989/rest/process" -H "accept: application/json" -H "Content-Type: application/json" -d "{ \"content\": \"Trump issues stark warning to Iran\As tensions between the U.S. and the Iranian regime continue to mount, President Trump suggested Wednesday that any potential war with Iran \\\"wouldn't last very long.\\\" During a phone interview on Fox Business' \\\"Mornings with Maria Bartiromo,\\\" Mr. Trump was asked if the United States would be going to war with the regime amid his threats of \\\"obliteration\\\" against the country.\\\\"I hope we don't, but we are in a very strong position,\\\" Mr. Trump said. He added, \\\"It wouldn't last very long, I can tell you that. It would not last very long. I'm not talking boots on ground...or sending a million soldiers.\\\"\The comments was the president's latest suggestion of military action against the Iranians after the administration issued its newest round of economic sanctions against the regime, this time targeting Iran's supreme leader and his office after Iran shot down an unmanned U.S. drone last week.\Iranian officials in response said the path to diplomacy between the two nations is now permanently closed. President Hassan Rouhani speaks in a cabinet meeting in Tehran, Iran, May 8, 2019. Last week, the president decided at the last minute to call off a retaliatory strike over the downed drone, saying he believed the casualty count would be disproportionate to Iran's attack. The president initially said he believed the strike was not intentional before walking back those comments on Saturday. Iranian President Hassan Rouhani, in a televised address, called the new sanctions \\\"outrageous and idiotic\\\" and said the White House was being \\\"afflicted by mental retardation.\\\"\Mr. Trump responded on Wednesday, saying: \\\"I don't think their leadership is very smart.\\\"\", \"language\": \"--size 15 --language eng\"}"
{
  "size": 15,
  "summary": "Trump issues stark warning to Iran\nAs tensions between the U.S. and the Iranian regime continue to mount, President Trump suggested Wednesday that any potential war with Iran \"wouldn't last very long.\" Last week, the president decided at the last minute to  call off a retaliatory strike  over the downed drone, saying he believed the casualty count would be disproportionate to Iran's attack."
}

Leave a Reply

Your email address will not be published. Required fields are marked *