text = """For the second time this year, the coronavirus has found its way to the very top of British politics and forced Prime Minister Boris Johnson into self-quarantine. On Sunday night, Johnson tweeted that he must "self-isolate for two weeks, after being in contact with someone with Covid-19." "It doesn't matter that I've had the disease and I'm bursting with antibodies," he said in a Monday video message, adding that he "felt great" and would keep leading the UK virus response, as well as his government's plans to "#BuildBackBetter." Yet the optimism in that message, including the hashtag, masks the reality of exactly how enormous a week this is for the Johnson premiership, and how much of a blow it is for the PM to be trapped in solitude. Downing Street had spent the weekend dealing with the fallout from three straight days of chaos, in which two of his most senior advisers dramatically resigned following allegations that they had been briefing viciously against both Johnson himself and his fiancée, Carrie Symonds. The advisers in question, Lee Cain and Dominic Cummings, were among the most controversial and disliked members of Johnson's inner circle and have been accused by numerous people in government of being power hungry and self-interested. Before Johnson's self-quarantining, the turmoil in Downing Street had dominated five days of coverage in the UK, overshadowing what is arguably an even bigger headache for the PM than the coronavirus. Brexit really is now on the home stretch. The current transition period -- which was designed to prevent a sudden halt of the flow of goods, among other things, between the UK and the European Union -- ends on December 31. If the two sides are unable to strike a free trade agreement before that date, then the chaotic no-deal cliff edge -- which many fear would lead to shortages in things like food, toilet paper and medicine -- would be the new reality. Thursday's video conference of the EU27 is the penultimate time that the heads of government from the bloc's member states are scheduled to meet before the end of the year. The final meeting of 2020, on December 10, is considered too late in the day. As has been the case for months, a deal is in sight and the areas of agreement vastly outweigh the areas of disagreement. However, the key stumbling blocks that have prevented a deal remain. The first and most important is Brussels' insistence on a level playing field in exchange for access to the EU's single market. This, for some time, has been a red line for the UK, which objects to being bound by EU competition rules prohibiting how the government could use state aid to help the growth of British enterprise. The two other key sticking points -- fishing rights and the involvement of EU law in the arbitration of any deal -- are also difficult, though it's easier to see a path to agreement in both. It has for some time been assumed that when the talks reached the stages that they are at now (with legal texts on the table and a deal within grasp), the negotiators, who are civil servants acting on the mandate of their political leadership, would make way for political leaders to bridge the final gaps."""

from nltk.tokenize import RegexpTokenizer
tokenizer = RegexpTokenizer(r'\w+')

words = tokenizer.tokenize(text)

en_stops = set(stopwords.words('english'))

filterd = []
for x in words:
  if x not in en_stops:
    filterd.append(x)

from nltk.stem import PorterStemmer

ps = PorterStemmer()
stemmered = []
for x in filterd:
  stemmered.append(ps.stem(x))

new = lemmatize_with_postag(sentence)

new_words = tokenizer.tokenize(new)

from nltk import sentiment
from nltk.sentiment.vader import SentimentIntensityAnalyzer 
   
def sentiment_scores(sentence): 
  
    sid_obj = SentimentIntensityAnalyzer() 
   
    sentiment_dict = sid_obj.polarity_scores(sentence) 
      
    print("Overall sentiment dictionary is : ", sentiment_dict) 
    print("sentence was rated as ", sentiment_dict['neg']*100, "% Negative") 
    print("sentence was rated as ", sentiment_dict['neu']*100, "% Neutral") 
    print("sentence was rated as ", sentiment_dict['pos']*100, "% Positive") 
  
    print("Sentence Overall Rated As", end = " ") 
   
    if sentiment_dict['compound'] >= 0.05 : 
        print("Positive") 
  
    elif sentiment_dict['compound'] <= - 0.05 : 
        print("Negative") 
  
    else : 
        print("Neutral") 

text2 = """President Donald Trump is facing a barrage of calls to permit potentially life-saving transition talks between his health officials and incoming President-elect Joe Biden's aides on a fast-worsening pandemic he is continuing to ignore in his obsessive effort to discredit an election that he clearly lost. The increasingly urgent pleas are coming from inside his administration, the President-elect's team and independent public health experts as Covid-19 cases rage out of control countrywide, claiming more than 1,000 US lives a day. More than 246,000 Americans have now died from the disease, and a bitter winter lies ahead even amid encouraging news such as Monday's announcement that a vaccine developed by Moderna is demonstrating a high success rate in early clinical trials, the second such positive vaccine news in about a week. But instead of listening or mobilizing to tackle what some medical experts warn is becoming a "humanitarian" crisis, Trump spent the weekend during which the US passed 11 million infections amplifying lies and misinformation about his election loss. At one point, he appeared to acknowledge Sunday in a tweet that Biden won, before backtracking with a stream of defiance on Twitter. This came as the nation's top infectious disease expert, Dr. Anthony Fauci, said on CNN's "State of the Union" Sunday that "of course it would be better if we could start working with" the Biden team that will take office on January 20. Biden's incoming White House chief of staff Ron Klain said Sunday that the President-elect's team had been unable to talk to current top health officials like Fauci about the pandemic owing to Trump's refusal to trigger ascertainment — the formal process of opening a transition to a new administration. "Joe Biden's going to become president of the United States in the midst of an ongoing crisis. That has to be a seamless transition," Klain said on NBC's "Meet the Press," adding that while the new administration planned to contact top pharmaceutical firms making the vaccine like Pfizer, it was particularly key to get in touch with Department of Health and Human Services officials responsible for rolling it out in the coming months. But the official who is currently most influential with the President, Dr. Scott Atlas, who critics say favors a herd immunity approach that could lead to thousands of deaths, wrote an inflammatory tweet on Sunday that exemplified the White House's contempt for unifying leadership during the pandemic. Atlas called on the people of Michigan to "rise up" against new Covid-19 restrictions introduced in schools, theaters and restaurants by Democratic Gov. Gretchen Whitmer -- who was recently the target of an alleged domestic terrorism kidnapping plot."""

words2 = tokenizer.tokenize(text2)
filtered2 = [w for w in words2 if w not in en_stops]
stemmered2 = [ps.stem(w) for w in filtered2]
freq_words2 = FreqDist(stemmered2)