version 0.1, Apr 2016
This notebook is licensed under a Creative Commons Attribution-ShareAlike 3.0 Unported License.
Information retrieval (IR) is the activity of obtaining information resources relevant to an information need from a collection of information resources. Searches can be based on metadata or on full-text (or other content-based) indexing. (Wikipedia)
url_ = 'http://mashable.com/2016/04/01/facebook-live-shooting/?utm_cid=mash-prod-nav-sub-st#44rpYp4efOqf'
from IPython.display import IFrame
IFrame(url_, 600, 600)
If we want to collect information on hundreds or twosands of webpages doing it manually is a no go. Instead, lets get the information of the webpage into python using web scraping
import urllib.request
response = urllib.request.urlopen(url_)
html = response.read()
html[0:800]
b'<!DOCTYPE html>\n<!--\no o o + o\n+ + + o + +\n +\no + + o + + +\n __ __ _ _ _\n~_,-| \\/ | __ _ ___| |__ __ _| |__ | | ___\n | |\\/| |/ _` / __| \'_ \\ / _` | \'_ \\| |/ _ \\,-~_,- - - ,\n~_,-| | | | (_| \\__ \\ | | | (_| | |_) | | __/ | /\\_/\\\n |_| |_|\\__,_|___/_| |_|\\__,_|_.__/|_|\\___| ~=|__( ^ .^)\n~_,-~_,-~_,-~_,-~_,-~_,-~_,-~_,-~_,-~_,-~_,-~_,-~_,"" ""\no o o + o\n+ + + o + +\n +\no + + o + + +\n-->\n<html data-env=\'production\' lang=\'en\' xml:lang=\'en\'>\n<head>\n<script>\n window.__o = {"channel":"world","content_type":"article","v_buy":null,"v_buy_i":null,"h_pub":16.0,"h_buy":null,"h_pub'
from bs4 import BeautifulSoup
soup = BeautifulSoup(html, 'html.parser')
print(soup.prettify())
<!DOCTYPE html> <!-- o o o + o + + + o + + + o + + o + + + __ __ _ _ _ ~_,-| \/ | __ _ ___| |__ __ _| |__ | | ___ | |\/| |/ _` / __| '_ \ / _` | '_ \| |/ _ \,-~_,- - - , ~_,-| | | | (_| \__ \ | | | (_| | |_) | | __/ | /\_/\ |_| |_|\__,_|___/_| |_|\__,_|_.__/|_|\___| ~=|__( ^ .^) ~_,-~_,-~_,-~_,-~_,-~_,-~_,-~_,-~_,-~_,-~_,-~_,-~_,"" "" o o o + o + + + o + + + o + + o + + + --> <html data-env="production" lang="en" xml:lang="en"> <head> <script> window.__o = {"channel":"world","content_type":"article","v_buy":null,"v_buy_i":null,"h_pub":16.0,"h_buy":null,"h_pub_buy":null,"v_cur":0.1,"v_max":0.1,"v_cur_i":0,"v_max_i":0,"events":"event51,event61","top_channel":"world","content_source_type":"Internal","content_source_name":"Internal","author_name":"Brian Ries","age":"0","pub_day":1,"pub_month":4,"pub_year":2016,"pub_date":"04/01/2016","sourced_from":"Internal","isPostView":true,"post_lead_type":"Alt Image Lead","topics":"Chicago,Facebook,facebook live,shooting,World","campaign":null,"display_mode":null,"viral_video_type":null,"b_flag":false}; window._gaq = window._gaq || []; window._gaq.push(['_setAccount', 'UA-92124-1']); window._geo = "US"; window.__domStart = (new Date().getTime()) </script> <title> Chicago man appears to stream his own shooting on Facebook </title> <link href="http://rack.3.mshcdn.com/assets/app-105409f8969e79e421fd4a2e84721dad.css" media="screen" rel="stylesheet" type="text/css"/> <link href="http://rack.0.mshcdn.com/assets/posts-c254e869452e4d1aa0c266cf22d8a613.css" media="all" rel="stylesheet" type="text/css"/> <!--[if lte IE 8]> <link href="http://rack.3.mshcdn.com/assets/iehax-a92ea2679dfac0fd022bcbffb7a40eeb.css" media="screen" rel="stylesheet" type="text/css" /> <![endif]--> <meta content="no" name="apple-mobile-web-app-capable"> <meta content="width=device-width, initial-scale=1.0" name="viewport"> <link href="https://plus.google.com/113493854651753327245" rel="publisher"> <link href="http://feeds.mashable.com/Mashable" rel="alternate" title="Mashable" type="application/rss+xml"> <link href="/apple-touch-icon-57x57.png?v=m2Pmw8zNwl" rel="apple-touch-icon" sizes="57x57"> <link href="/apple-touch-icon-60x60.png?v=m2Pmw8zNwl" rel="apple-touch-icon" sizes="60x60"> <link href="/apple-touch-icon-72x72.png?v=m2Pmw8zNwl" rel="apple-touch-icon" sizes="72x72"> <link href="/apple-touch-icon-76x76.png?v=m2Pmw8zNwl" rel="apple-touch-icon" sizes="76x76"> <link href="/apple-touch-icon-114x114.png?v=m2Pmw8zNwl" rel="apple-touch-icon" sizes="114x114"> <link href="/apple-touch-icon-120x120.png?v=m2Pmw8zNwl" rel="apple-touch-icon" sizes="120x120"> <link href="/apple-touch-icon-144x144.png?v=m2Pmw8zNwl" rel="apple-touch-icon" sizes="144x144"> <link href="/apple-touch-icon-152x152.png?v=m2Pmw8zNwl" rel="apple-touch-icon" sizes="152x152"> <link href="/apple-touch-icon-180x180.png?v=m2Pmw8zNwl" rel="apple-touch-icon" sizes="180x180"> <link href="/favicon-32x32.png?v=m2Pmw8zNwl" rel="icon" sizes="32x32" type="image/png"> <link href="/android-chrome-192x192.png?v=m2Pmw8zNwl" rel="icon" sizes="192x192" type="image/png"> <link href="/favicon-96x96.png?v=m2Pmw8zNwl" rel="icon" sizes="96x96" type="image/png"> <link href="/favicon-16x16.png?v=m2Pmw8zNwl" rel="icon" sizes="16x16" type="image/png"> <link href="/manifest.json?v=m2Pmw8zNwl" rel="manifest"> <link href="/favicon.ico?v=m2Pmw8zNwl" rel="shortcut icon"> <meta content="#da532c" name="msapplication-TileColor"> <meta content="/mstile-144x144.png?v=m2Pmw8zNwl" name="msapplication-TileImage"> <meta content="#ffffff" name="theme-color"> <meta content="mid:12105681" name="linkedin:owner"> <meta content="122071082108" property="fb:app_id"> <meta content="18807449704" property="fb:page_id"> <meta content="nYmtX7H2sSCkK8gHpQGxr7Es2526DgUaqb6PGYSX" name="readability-verification"> <meta content="YfjJNAwfOEsk9gCpEyro9wrDs3yzGlkO1w2tJ7GdxDo" name="google-site-verification"> <meta content="app-id=910775754" name="apple-itunes-app"> <link href="http://rack.0.mshcdn.com/assets/mashable.touchicon-fef1d080d993d3b95408f12ab39b03f0.png" rel="apple-touch-icon-precomposed"> <meta content="authenticity_token" name="csrf-param"/> <meta content="gf4mkepHBNnVwN09Bwt0M2q4sZz6LJ0FFAmVl+e7UXI=" name="csrf-token"/> <link data-page-subject="true" href="http://mashable.com/2016/04/01/facebook-live-shooting/" rel="canonical"/> <link data-page-subject="true" href="http://rack.3.mshcdn.com/media/ZgkyMDE2LzA0LzAxL2QzL3Nob290ZXIuYWQwNjUuanBnCnAJdGh1bWIJMTIwMHg2MjcjCmUJanBn/764bc2c7/1d6/shooter.jpg" rel="image_src"/> <meta content="http://mashable.com/2016/04/01/facebook-live-shooting/" data-page-subject="true" property="og:url"/> <meta content="Chicago man appears to stream his own shooting on Facebook" data-page-subject="true" property="og:title"/> <meta content="article" data-page-subject="true" property="og:type"/> <meta content="Mashable" data-page-subject="true" property="og:site_name"/> <meta content="Chicago Police are investigating an extraordinary video that appears to capture the shooting of a man while he was streaming on Facebook Live." data-page-subject="true" property="og:description"/> <meta content="http://rack.0.mshcdn.com/media/ZgkyMDE2LzA0LzAxL2QzL3Nob290ZXIuYWQwNjUuanBnCnAJdGh1bWIJMTIwMHg2MzAKZQlqcGc/13367dc7/1d6/shooter.jpg" data-page-subject="true" property="og:image"/> <meta content="2016-04-01T23:26:01Z" data-page-subject="true" property="og:article:published_time"/> <meta content="2016-04-01T23:45:00Z" data-page-subject="true" property="og:article:modified_time"/> <meta content="https://www.facebook.com/mashable" data-page-subject="true" property="og:article:publisher"/> <meta content="Chicago Police are investigating an extraordinary video that appears to capture the shooting of a man while he was streaming on Facebook Live." data-page-subject="true" name="description"/> <meta content="chicago, shooting, facebook-live, facebook, world" data-page-subject="true" name="keywords"/> <meta content="Chicago man appears to stream his own shooting on Facebook" data-page-subject="true" name="twitter:title"/> <meta content="I guess it was only a matter of time. " data-page-subject="true" name="twitter:description"/> <meta content="http://rack.0.mshcdn.com/media/ZgkyMDE2LzA0LzAxL2QzL3Nob290ZXIuYWQwNjUuanBnCnAJdGh1bWIJNTYweDc1MAplCWpwZw/5cd68b1a/1d6/shooter.jpg" data-page-subject="true" name="twitter:image"/> <meta content="@mashable" data-page-subject="true" name="twitter:site"/> <meta content="mashable" data-page-subject="true" name="twitter:via"/> <meta content="http://mashable.com/2016/04/01/facebook-live-shooting/" data-page-subject="true" name="twitter:url"/> <meta content="@mashable" data-page-subject="true" name="twitter:creator"/> <meta content="photo" data-page-subject="true" name="twitter:card"/> <meta content="560" data-page-subject="true" name="twitter:image:width"/> <meta content="750" data-page-subject="true" name="twitter:image:height"/> <meta content="2016-04-01 23:26:01 UTC" data-page-subject="true" name="date"/> <meta content="Brian Ries" data-page-subject="true" name="sailthru.author"/> <meta content="http://rack.2.mshcdn.com/media/ZgkyMDE2LzA0LzAxL2QzL3Nob290ZXIuNmJjOTMuanBnCnAJdGh1bWIJMTE1eDExNSMKZQlqcGc/7f31eddf/9f6/shooter.jpg" data-page-subject="true" name="sailthru.image.thumb"/> <meta content="http://rack.3.mshcdn.com/media/ZgkyMDE2LzA0LzAxL2QzL3Nob290ZXIuNmJjOTMuanBnCnAJdGh1bWIJOTUweDUzNCMKZQlqcGc/8f2db68b/9f6/shooter.jpg" data-page-subject="true" name="sailthru.image.full"/> <meta content="http://rack.1.mshcdn.com/media/ZgkyMDE2LzA0LzAxL2QzL3Nob290ZXIuNmJjOTMuanBnCnAJdGh1bWIJNjAweDMzOCMKZQlqcGc/238675fe/9f6/shooter.jpg" data-page-subject="true" name="sailthru.lead_image"/> <meta content="http://rack.3.mshcdn.com/media/ZgkyMDE2LzA0LzAxL2QzL3Nob290ZXIuNmJjOTMuanBnCnAJdGh1bWIJMjg4eDE2MiMKZQlqcGc/6a8e55f0/9f6/shooter.jpg" data-page-subject="true" name="sailthru.secondary_image"/> <meta content="false" data-page-subject="true" name="sailthru.exclude_homepage"/> <meta content="false" data-page-subject="true" name="sailthru.exclude_uk"/> <meta content="false" data-page-subject="true" name="sailthru.exclude_australia"/> <meta content="false" data-page-subject="true" name="sailthru.exclude_india"/> <meta content="Brian Ries" data-page-subject="true" name="author"/> <meta content="http://on.mash.to/1pSuJjr" data-page-subject="true" name="short_url"/> <script type="application/ld+json"> {"@context":"http://schema.org","headline":"Chicago man appears to stream his own shooting on Facebook","url":"http://mashable.com/2016/04/01/facebook-live-shooting/","image":"http://rack.3.mshcdn.com/media/ZgkyMDE2LzA0LzAxL2QzL3Nob290ZXIuYWQwNjUuanBnCnAJdGh1bWIJMTIwMHg2MjcjCmUJanBn/764bc2c7/1d6/shooter.jpg","keywords":["chicago","shooting","facebook-live","facebook","world"],"@type":"Article","dateCreated":"2016-04-01T23:26:01Z","datePublished":"2016-04-01T23:26:01Z","articleSection":"world","creator":"Brian Ries","author":"Brian Ries","mainEntityOfPage":"True","metadata":{"page":1,"omnitureData":{"channel":"world","content_type":"article","v_buy":null,"v_buy_i":null,"h_pub":16.0,"h_buy":null,"h_pub_buy":null,"v_cur":0.1,"v_max":0.1,"v_cur_i":0,"v_max_i":0,"events":"event51,event61","top_channel":"world","content_source_type":"Internal","content_source_name":"Internal","author_name":"Brian Ries","age":"0","pub_day":1,"pub_month":4,"pub_year":2016,"pub_date":"04/01/2016","sourced_from":"Internal","isPostView":true,"post_lead_type":"Alt Image Lead","topics":"Chicago,Facebook,facebook live,shooting,World","campaign":null,"display_mode":null,"viral_video_type":null,"b_flag":false},"postId":null}} </script> <script src="//cdn.optimizely.com/js/58011369.js"> </script> <script async="async" src="http://widgets.outbrain.com/outbrain.js"> </script> <script async="async" src="//cdn.connatix.com/min/connatix.handler.dfp.min.js"> </script> <script src="http://rack.2.mshcdn.com/assets/advertisement-060f46eaa4b4b7eb4cfc22a60aa890ba.js" type="text/javascript"> </script> <script src="http://rack.1.mshcdn.com/assets/app-e00dc2a7876ac17076ba0e96a8c95779.js" type="text/javascript"> </script> <!--[if lte IE 8]> <script src="http://rack.1.mshcdn.com/assets/polyfill-dbcc2a2d7d3822e949277216824a7e49.js" type="text/javascript"></script> <![endif]--> <script> !function(f,b,e,v,n,t,s){if(f.fbq)return;n=f.fbq=function(){n.callMethod? n.callMethod.apply(n,arguments):n.queue.push(arguments)};if(!f._fbq)f._fbq=n; n.push=n;n.loaded=!0;n.version='2.0';n.queue=[];t=b.createElement(e);t.async=!0; t.src=v;s=b.getElementsByTagName(e)[0];s.parentNode.insertBefore(t,s)}(window, document,'script','//connect.facebook.net/en_US/fbevents.js'); fbq('init', '1453039084979896'); fbq('track', "PageView"); </script> <noscript> <img height="1" src="https://www.facebook.com/tr?id=1453039084979896&ev=PageView&noscript=1" style="display:none" width="1"> </img> </noscript> </link> </meta> </meta> </meta> </meta> </meta> </meta> </meta> </meta> </meta> </link> </link> </link> </link> </link> </link> </link> </link> </link> </link> </link> </link> </link> </link> </link> </link> </link> </meta> </meta> </head> <body class="body_posts body_show" data-jsid="posts/show" data-sec0="world" data-sec1="us" data-sec2="posts" data-topic="facebook" viewport="fixed"> <h1 class="semantic"> Mashable </h1> <header id="flyout-container"> </header> <div id="peek"> <div id="sticky"> <div class="cookie-notice"> <div class="wrap"> We're using cookies to improve your experience. <a class="cta" href="/cookie-policy/"> Click Here to find out more. </a> <div class="dismiss"> </div> </div> </div> <header id="site-header"> <div class="navbar"> <div class="navbar-inner"> <ul class="inline main-menu nav us"> <li class="menu"> <a class="icon-reorder" href="#"> </a> </li> <li class="logo us"> <a class="brand" data-turbo-target="body-container" href="/"> <span> Mashable </span> <img alt="Header_logo.v2.us" class="light" src="http://rack.3.mshcdn.com/assets/header_logo.v2.us-52e68666fbc19a6f91648a6aec2a4209.png"/> <img alt="Header_logo.v2.us.dark" class="dark" src="http://rack.1.mshcdn.com/assets/header_logo.v2.us.dark-9f775fba3e1140cab3876dac5399dd28.png"/> </a> <div class="geos-content"> <a class="geo" href="?geo=AS&utm_cid=mash-prod-nav-geo" onclick='$.cookie("geo","AS")'> Mashable Asia </a> <a class="geo" href="?geo=AU&utm_cid=mash-prod-nav-geo" onclick='$.cookie("geo","AU")'> Mashable Australia </a> <a class="geo" href="http://mashable.france24.com/?ns_campaign=mashablefr&ns_source=mashnav"> Mashable France </a> <a class="geo" href="?geo=IN&utm_cid=mash-prod-nav-geo" onclick='$.cookie("geo","IN")'> Mashable India </a> <a class="geo" href="?geo=GB&utm_cid=mash-prod-nav-geo" onclick='$.cookie("geo","GB")'> Mashable UK </a> </div> </li> <li class="submenu collapsable pull-right" id="sign-in"> <a href="/login/"> <span> Sign in </span> </a> </li> <li class="follow submenu follow-menu pull-right"> <a class="follow-trigger" href="/follow-mashable/"> <span class="fb"> </span> <span class="tw"> </span> <span class="gp"> </span> </a> <div class="dropdown-menu pull-right social-badges"> <ul> <li class="facebook-container"> <a class="social-stub social-share facebook like" data-default="1" data-href="http://facebook.com/mashable" data-shares="2.4m"> Like </a> </li> <li> <a class="twitter-follow-button" data-dnt="true" data-show-count="true" data-show-screen-name="false" href="https://twitter.com/mashable"> Follow </a> </li> <li class="linked-in"> <script data-counter="right" data-id="200000" type="IN/FollowCompany"> </script> </li> <li> <a class="social-stub social-share google_plus follow" data-shares="7.1m" href="https://plus.google.com/+Mashable/auto" target="_blank"> Follow </a> </li> <li> <iframe allowtransparency="true" border="0" frameborder="0" height="20" id="tmblrFollowBtn" scrolling="no" width="100"> </iframe> </li> <li> <div class="pinterest"> <a data-pin-do="buttonFollow" href="http://www.pinterest.com/Mashable/"> Mashable </a> </div> </li> <li> <iframe id="mkFollowBtn" scrolling="no" seamless="seamless" style="border:none; height: 26px" width="145"> </iframe> </li> <li> <a alt="RSS Feed" class="rss" href="http://feeds.mashable.com/Mashable" title="RSS Feed"> </a> <a alt="Email Subscriptions" class="email" href="/subscriptions" title="Email Subscriptions"> </a> <div class="more"> <a href="/follow-mashable"> see more > </a> </div> </li> </ul> </div> </li> <li class="nav-search submenu pull-right"> <a class="search-trigger" href="/search/"> Search </a> <div class="dropdown-content"> <div class="page-container"> <div class="header-search-form"> <form accept-charset="UTF-8" action="/search/" method="get"> <div style="margin:0;padding:0;display:inline"> <input name="utf8" type="hidden" value="✓"/> </div> <div class="ie-search-wrapper"> <input autocomplete="off" class="header-search" id="q" name="q" type="text" value=""/> </div> <input class="btn btn-primary header-search-submit" name="commit" type="submit" value="Search"/> </form> <div class="header-search-results"> </div> </div> </div> </div> </li> <li class="collapsable channel" data-channel="Videos" data-tags=""> <a href="/videos/?utm_cid=mash-prod-nav-ch"> Videos </a> </li> <li class="collapsable channel submenu" data-channel="Social Media" data-tags="how-to,facebook,twitter,youtube,google-plus"> <a href="/social-media/?utm_cid=mash-prod-nav-ch"> Social Media </a> <div class="submenu-content"> </div> </li> <li class="collapsable channel submenu" data-channel="Tech" data-tags="apps-software,dev-design,gadgets,mobile,cars"> <a href="/tech/?utm_cid=mash-prod-nav-ch"> Tech </a> <div class="submenu-content"> </div> </li> <li class="collapsable channel submenu" data-channel="Business" data-tags="advertising,marketing,media,small-business,startups,jobs"> <a href="/business/?utm_cid=mash-prod-nav-ch"> Business </a> <div class="submenu-content"> </div> </li> <li class="collapsable channel submenu" data-channel="Entertainment" data-tags="film,gaming,music,sports,television"> <a href="/entertainment/?utm_cid=mash-prod-nav-ch"> Entertainment </a> <div class="submenu-content"> </div> </li> <li class="collapsable channel submenu" data-channel="World" data-tags="us,climate,retronaut,space,australia,uk,social-good"> <a href="/world/?utm_cid=mash-prod-nav-ch"> World </a> <div class="submenu-content"> </div> </li> <li class="collapsable channel submenu" data-channel="Lifestyle" data-tags="family-parenting,fashion,health-fitness,home,travel,work-and-play,food"> <a href="/lifestyle/?utm_cid=mash-prod-nav-ch"> Lifestyle </a> <div class="submenu-content"> </div> </li> <li class="collapsable channel submenu" data-channel="Watercooler" data-tags="pics,memes,comics,conversations,videos-watercooler"> <a href="/watercooler/?utm_cid=mash-prod-nav-ch"> Watercooler </a> <div class="submenu-content"> </div> </li> <li class="collapsable channel" data-channel="Shop" data-tags=""> <a href="http://shop.mashable.com?utm_source=mashable&utm_medium=nav"> Shop </a> </li> <li class="submenu more"> <a href="#"> <!-- %span=t "header.nav.more" --> <span> More </span> </a> <div class="submenu-content"> <div class="page-container"> <ul class="columns"> <li> <ul class="column-list"> <li class="header"> Channels </li> <li> <a href="/videos/"> Videos </a> </li> <li> <a href="/social-media/"> Social Media </a> </li> <li> <a href="/tech/"> Tech </a> </li> <li> <a href="/business/"> Business </a> </li> <li> <a href="/entertainment/"> Entertainment </a> </li> <li> <a href="/world/"> World </a> </li> <li> <a href="/lifestyle/"> Lifestyle </a> </li> <li> <a href="/watercooler/"> Watercooler </a> </li> <li> <a href="http://shop.mashable.com?utm_source=mashable&utm_medium=nav"> Shop </a> </li> </ul> </li> <li> <ul class="column-list"> <li class="header"> Company </li> <li> <a href="/about/"> About Us </a> </li> <li> <a href="http://www.wrightsmedia.com/sites/mashable/"> Licensing & Reprints </a> </li> <li> <a href="http://mashable.com/2014/"> Archive </a> </li> <li> <a href="http://mashable.theresumator.com/"> Mashable Careers </a> </li> </ul> </li> <li> <ul class="column-list"> <li class="header"> Contact </li> <li> <a href="/contact-us/"> Contact Us </a> </li> <li> <a href="/submit/"> Submit News </a> </li> </ul> </li> <li> <ul class="column-list"> <li class="header"> Advertise </li> <li> <a href="/advertise/"> Advertise </a> </li> </ul> </li> <li> <ul class="column-list"> <li class="header"> Legal </li> <li> <a href="/privacy/"> Privacy Policy </a> </li> <li> <a href="/terms/"> Terms of Use </a> </li> <li> <a href="/cookie-policy/"> Cookie Policy </a> </li> </ul> </li> <li> <ul class="column-list"> <li class="header"> Apps </li> <li> <a href="https://itunes.apple.com/us/app/mashable/id910775754?mt=8"> iPhone / iPad </a> </li> <li> <a href="https://play.google.com/store/apps/details?id=com.mashable.android.phoenix"> Android </a> </li> </ul> </li> <li> <ul class="column-list"> <li class="header"> Resources </li> <li> <a href="/follow-mashable/"> Subscriptions </a> </li> </ul> </li> <li> <ul class="column-list"> <li class="header"> Sites </li> <li> <a href="http://shop.mashable.com?utm_source=mashable&utm_medium=nav"> Mashable Shop </a> </li> <li> <a href="http://findjobs.mashable.com"> Job Board </a> </li> <li> <a href="http://mashable.com/sgs/"> Social Good Summit </a> </li> <li> <a href="http://mashable.com/media-summit/"> Media Summit </a> </li> </ul> </li> </ul> </div> </div> </li> </ul> </div> </div> </header> </div> <div id="scrollable"> <div class="loader"> </div> <div class="ad_container ad-slot" data-overrides='{"targeting":{"tile":3,"adnum":3,"sec0":"world","sec1":"us","sec2":"posts","topic":"facebook"}}' data-type="survey"> </div> <header class="box970"> <div class="page-container"> <center class="visible-desktop"> <div class="ad_container ad-slot" data-overrides='{"targeting":{"tile":4,"adnum":1,"sec0":"world","sec1":"us","sec2":"posts","topic":"facebook"}}' data-type="banner"> </div> </center> </div> </header> <div class="posts show" id="body-container"> <div id="main"> <div class="page-container"> <div id="body"> <img height="0" id="bluekai-test-img" src="http://mashable.com/favicon-16x16.png?bk_uuid=$_BK_UUID&BK_SWAP_DEST=19275" width="0"> <hgroup class="page-header channel" data-channel="world" data-section="sec0=world&sec1=index&sec2=" id="post-head"> <h2> World </h2> <div class="follow-channel"> <div class="follow-buttons"> <a class="social-stub social-share facebook like" data-default="1" data-href="http://facebook.com/mashable" data-shares="1.7m"> Like </a> <a class="social-stub social-share twitter follow" data-shares="3.7m" href="https://twitter.com/intent/follow?region=follow_link&screen_name=mashable&tw_p=followbutton&variant=2.0" target="_blank"> Follow </a> <a class="social-stub social-share google_plus follow" data-shares="7.1m" href="https://plus.google.com/+Mashable/auto" target="_blank"> Follow </a> </div> </div> </hgroup> <div class="flex-box"> <div class="box-cell"> <div id="post-content"> <div id="post-slider"> <article class="blueprint full post" data-bp-id="4516" data-channel="world" data-id="56ff03c4b05f9d2bb4000215" data-subchannels="us" data-topic="facebook" data-velocity="274,273,272,272,273,272,271,272,274,278,284,292,303,317,331,347,363,382,400,419,438,457,477,497,517,537,556,577,597,617,637,657,678,698,718,738,757,777,795,814,832,851,869,887,905,924,943,962,981,1000" id="story"> <header class="article-header"> <h1 class="title" href="http://mashable.com/2016/04/01/facebook-live-shooting/"> Chicago man appears to stream his own shooting on Facebook </h1> <aside class="shares social"> <div class="total-shares" data-index="0"> <em> 1.5k </em> <div class="caption"> Shares </div> </div> <div class="share-buttons"> <div class="share-button-boxy"> <a class="social-stub social-share facebook" data-image="http://rack.0.mshcdn.com/media/ZgkyMDE2LzA0LzAxL2QzL3Nob290ZXIuYWQwNjUuanBnCnAJdGh1bWIJMTIwMHg2MzAKZQlqcGc/13367dc7/1d6/shooter.jpg" data-shares="186" data-title="Chicago man appears to stream his own shooting on Facebook" data-uid="1aQ" href="#"> Share </a> </div> <div class="share-button-boxy"> <a class="social-stub social-share twitter" data-shares="1333" data-tweet-text="Chicago man appears to stream his own shooting on Facebook" data-uid="1aQ" href="https://twitter.com/intent/tweet?original_referer=http://mashable.com/&source=tweetbutton&text=Chicago+man+appears+to+stream+his+own+shooting+on+Facebook&url=http%3A%2F%2Fmashable.com%2F2016%2F04%2F01%2Ffacebook-live-shooting%2F&via=mashable"> Tweet </a> </div> <div class="share-button-boxy"> <a class="social-stub social-share google_plus" data-image="http://rack.0.mshcdn.com/media/ZgkyMDE2LzA0LzAxL2QzL3Nob290ZXIuYWQwNjUuanBnCnAJdGh1bWIJMTIwMHg2MzAKZQlqcGc/13367dc7/1d6/shooter.jpg" data-shares="5" data-title="Chicago man appears to stream his own shooting on Facebook" data-uid="1aQ" href="#"> Share </a> </div> <div class="share-button-boxy"> <a class="social-stub social-share linked_in" data-image="http://rack.0.mshcdn.com/media/ZgkyMDE2LzA0LzAxL2QzL3Nob290ZXIuYWQwNjUuanBnCnAJdGh1bWIJMTIwMHg2MzAKZQlqcGc/13367dc7/1d6/shooter.jpg" data-shares="13" data-title="Chicago man appears to stream his own shooting on Facebook" data-uid="1aQ" href="#"> </a> </div> <div class="share-button-boxy"> <a class="social-stub social-share stumble_upon" data-image="http://rack.0.mshcdn.com/media/ZgkyMDE2LzA0LzAxL2QzL3Nob290ZXIuYWQwNjUuanBnCnAJdGh1bWIJMTIwMHg2MzAKZQlqcGc/13367dc7/1d6/shooter.jpg" data-shares="0" data-title="Chicago man appears to stream his own shooting on Facebook" data-uid="1aQ" href="#"> </a> </div> <div class="share-button-boxy"> <a class="social-stub social-share pinterest" data-image="http://rack.0.mshcdn.com/media/ZgkyMDE2LzA0LzAxL2QzL3Nob290ZXIuYWQwNjUuanBnCnAJdGh1bWIJMTIwMHg2MzAKZQlqcGc/13367dc7/1d6/shooter.jpg" data-shares="1" data-title="Chicago man appears to stream his own shooting on Facebook" data-uid="1aQ" href="#"> </a> </div> </div> <div class="velocity-graph tooltip-trigger" title="The Mashable Velocity graph shows how quickly people are sharing this article on the social Web."> <canvas class="velocity"> </canvas> <div class="caption"> What's This? </div> </div> </aside> <figure class="article-image"> <img alt="Shooter" class="microcontent" data-fragment="lead-image" data-image="/media/ZgkyMDE2LzA0LzAxL2QzL3Nob290ZXIuNmJjOTMuanBnCnAJdGh1bWIJOTUweDUzNCMKZQlqcGc/8f2db68b/9f6/shooter.jpg" data-micro="1" data-url="null" src="http://rack.3.mshcdn.com/media/ZgkyMDE2LzA0LzAxL2QzL3Nob290ZXIuNmJjOTMuanBnCnAJdGh1bWIJOTUweDUzNCMKZQlqcGc/8f2db68b/9f6/shooter.jpg"/> <figcaption class="image-caption"> A man is seen firing a gun in a Facebook Live video reportedly taken in Chicago. </figcaption> <div class="image-credit"> Image: Facebook </div> </figure> <div class="article-info"> <a class="byline " href="/people/moneyries/"> <img alt="Headshot_2015_brianries_updatedshot_1" class="author_image" src="http://rack.0.mshcdn.com/media/ZgkyMDE1LzA2LzIyLzBjL0hlYWRzaG90XzIwLjdiMmE5LmpwZwpwCXRodW1iCTkweDkwIwplCWpwZw/e4aef619/c0c/Headshot_2015_BrianRies_UpdatedShot_1.jpg"/> <div class="author_and_date"> <span class="author_name"> By Brian Ries </span> <time datetime="Fri, 01 Apr 2016 23:26:01 +0000"> 2016-04-01 23:26:01 UTC </time> </div> </a> </div> </header> <section class="article-content blueprint"> <div class="post-text"> <p> I guess it was only a matter of time. </p> <p> Chicago Police are investigating an extraordinary video that appears to capture the shooting of a man while he was streaming on Facebook Live. </p> <h2 class="h2"> Watch the video (graphic content): </h2> <div> <div id="fb-root"> </div> <div class="fb-video" data-allowfullscreen="1" data-href="/marie.creamer.549/videos/vb.100007259195441/1671424763109481/?type=3"> <div class="fb-xfbml-parse-ignore"> <blockquote cite="https://www.facebook.com/marie.creamer.549/videos/1671424763109481/"> <p> <a href="https://www.facebook.com/marie.creamer.549/videos/1671424763109481/" target="_blank"> </a> </p> <p> Damn he was on LIVE talking shit with no burner and got his life took smds shit crazy . #LITERALLY </p> <p> Posted by <a href="#" role="button" target="_blank"> TcWorld Creamer </a> on Thursday, March 31, 2016 </p> </blockquote> </div> </div> </div> <p> In the clip, which was re-recorded from its original source on Thursday and disseminated widely, a man in a blue Chicago White Sox hat is seen talking into the camera while standing in front of Scott's Convenience Store in Chicago's West Englewood neighborhood. </p> <p> He jokes that the store is open because he needed "somewhere to duck and hide for cover." </p> <figure class="image"> <p> <img alt="Scott's Convenience Store is seen in the Facebook video and on Google Street View." class="" data-caption="Scott's Convenience Store is seen in the Facebook video and on Google Street View." data-credit-name="google/facebook" data-credit-provider="custom type" data-fragment="m!5acd" data-image="http://rack.3.mshcdn.com/media/ZgkyMDE2LzA0LzAxLzQzL0NoaWNhZ29fRmFjLjUyN2M4LmpwZwpwCXRodW1iCTEyMDB4OTYwMD4/f6f0d8ab/35f/Chicago_Facebook_Shooting.jpg" data-micro="1" data-width="999" src="http://rack.3.mshcdn.com/media/ZgkyMDE2LzA0LzAxLzQzL0NoaWNhZ29fRmFjLjUyN2M4LmpwZwpwCXRodW1iCTEyMDB4OTYwMD4/f6f0d8ab/35f/Chicago_Facebook_Shooting.jpg"/> </p> <figcaption class="image-caption"> <p> Scott's Convenience Store is seen in the Facebook video and on Google Street View. </p> </figcaption> <div class="image-credit"> <p> Image: google/facebook </p> </div> </figure> <p> <span style="line-height: 1.5;"> Moments later, shots ring out and the phone drops to the street, camera up. The apparent assailant, wearing red, then steps into the frame and continues firing the gun elsewhere. </span> </p> <p> A minute passes and a woman begins screaming, “Oh my God, no! I can’t believe this." </p> <p> While many people have questioned the video's authenticity, especially as it surfaced in the hours before April Fools' Day, Chicago Police say it's likely legitimate. </p> <p> "CPD is aware of the social media video in question and suspect the video is connected to the incident," Officer Kevin Quaid, with the Office of News Affairs, told <i> Mashable. </i> </p> <div class="see-also move-option" contenteditable="false"> <p> SEE ALSO: <a data-crackerjax="#post-slider" href="http://mashable.com/2016/03/19/john-vachon-chicago/"> 1941 Chicago streets through the lens of a rookie FSA photographer </a> </p> </div> <p> He added that detectives were working to confirm its authenticity, but that a man, 31, was shot on Thursday at the location seen in the video and transported to Mount Sinai hospital in critical condition. </p> <p> Detectives are waiting to speak with the apparent victim, who is now under sedation, The Associated Press reported. </p> <p> The victim is believed to be a known gang member. </p> <p> Peter Nickeas, a <i> Chicago Tribune </i> reporter who wrote about the video, <a href="https://twitter.com/PeterNickeas/status/715745669386997760" target="_blank"> tweeted </a> that police are privately a lot more confident than their official statements suggest. </p> <div class="twitter-wrapper sort-rerender"> <div> <blockquote class="twitter-tweet"> <p dir="ltr" lang="en"> Video is probably real but important (essential, IMO) to make sure it's real, not just that it couldn't conceivably be fake. </p> <p> — Peter Nickeas (@PeterNickeas) <a href="https://twitter.com/PeterNickeas/status/715738986057216001" target="_blank"> April 1, 2016 </a> </p> </blockquote> </div> </div> <p> <span style="line-height: 1.5;"> "Video is probably real but important (essential, IMO) to make sure it's real, not just that it couldn't conceivably be fake," he said. "Police are privately more confident (a lot more) in the video's authenticity than the CPD news affairs statement lets on." </span> </p> <p> If it proves to be real, this would probably be a first for the live video product Facebook CEO Mark Zuckerberg is <a href="http://recode.net/2016/02/26/mark-zuckerberg-is-obsessed-with-livestreaming-making-live-a-top-priority-at-facebook/" target="_blank"> reportedly </a> "obsessed" with. </p> <p> The shocking video comes as numerous news organizations have embraced the medium, which has been used to stream live scenes from protests, political events and average life. </p> <p> Violence in Chicago is reaching levels "unseen in years," <a href="http://www.chicagotribune.com/news/ct-chicago-homicides-first-quarter-met-20160330-story.html" target="_blank"> according to the <i> Tribune </i> </a> <i> </i> , with shootings up 73% over this time last year. <span style="line-height: 1.5;"> More than 700 people have been shot in the year's first quarter. </span> </p> <p> <span style="line-height: 1.5;"> The suspected shooter in Thursday's incident is still at large. </span> </p> <p contenteditable="false"> <em> Have something to add to this story? Share it in the comments. </em> </p> </div> <script> window._msla=window.loadScriptAsync||function(src,id){if(document.getElementById(id))return;var js=document.createElement('script');js.id=id;js.src=src;document.getElementsByTagName('script')[0].parentNode.insertBefore(js,fjs);}; _msla("//connect.facebook.net/en_US/sdk.js#xfbml=1&version=v2.3","facebook-jssdk");_msla("//platform.twitter.com/widgets.js","twitter_jssdk"); </script> </section> <div class="fb-quote"> </div> <section class="branded-content"> </section> <footer class="article-topics"> Topics: <a href="/category/chicago/"> Chicago </a> , <a href="/category/facebook/"> Facebook </a> , <a href="/category/facebook-live/"> facebook live </a> , <a href="/category/shooting/"> shooting </a> , <a href="/category/world/"> World </a> </footer> <footer> <div class="image-credit"> Image: Facebook </div> </footer> <div id="outbrain-container"> <div class="OUTBRAIN" data-ob-template="mashable" data-src="http://mashable.com/2016/04/01/facebook-live-shooting/" data-widget-id="AR_5"> </div> </div> <div data-display-daily-newsletter="hide" id="newsletter-signup"> </div> <script> if(window.pageChanged) window.omni({"channel":"world","content_type":"article","v_buy":null,"v_buy_i":null,"h_pub":16.0,"h_buy":null,"h_pub_buy":null,"v_cur":0.1,"v_max":0.1,"v_cur_i":0,"v_max_i":0,"events":"event51,event61","top_channel":"world","content_source_type":"Internal","content_source_name":"Internal","author_name":"Brian Ries","age":"0","pub_day":1,"pub_month":4,"pub_year":2016,"pub_date":"04/01/2016","sourced_from":"Internal","isPostView":true,"post_lead_type":"Alt Image Lead","topics":"Chicago,Facebook,facebook live,shooting,World","campaign":null,"display_mode":null,"viral_video_type":null,"b_flag":false}); metaData = {"link":[["canonical","http://mashable.com/2016/04/01/facebook-live-shooting/"],["image_src","http://rack.3.mshcdn.com/media/ZgkyMDE2LzA0LzAxL2QzL3Nob290ZXIuYWQwNjUuanBnCnAJdGh1bWIJMTIwMHg2MjcjCmUJanBn/764bc2c7/1d6/shooter.jpg"]],"meta_property":[["og:url","http://mashable.com/2016/04/01/facebook-live-shooting/"],["og:title","Chicago man appears to stream his own shooting on Facebook"],["og:type","article"],["og:site_name","Mashable"],["og:description","Chicago Police are investigating an extraordinary video that appears to capture the shooting of a man while he was streaming on Facebook Live."],["og:image","http://rack.0.mshcdn.com/media/ZgkyMDE2LzA0LzAxL2QzL3Nob290ZXIuYWQwNjUuanBnCnAJdGh1bWIJMTIwMHg2MzAKZQlqcGc/13367dc7/1d6/shooter.jpg"],["og:article:published_time","2016-04-01T23:26:01Z"],["og:article:modified_time","2016-04-01T23:45:00Z"],["og:article:publisher","https://www.facebook.com/mashable"]],"meta_name":[["description","Chicago Police are investigating an extraordinary video that appears to capture the shooting of a man while he was streaming on Facebook Live."],["keywords","chicago, shooting, facebook-live, facebook, world"],["twitter:title","Chicago man appears to stream his own shooting on Facebook"],["twitter:description","I guess it was only a matter of time.\n"],["twitter:image","http://rack.0.mshcdn.com/media/ZgkyMDE2LzA0LzAxL2QzL3Nob290ZXIuYWQwNjUuanBnCnAJdGh1bWIJNTYweDc1MAplCWpwZw/5cd68b1a/1d6/shooter.jpg"],["twitter:site","@mashable"],["twitter:via","mashable"],["twitter:url","http://mashable.com/2016/04/01/facebook-live-shooting/"],["twitter:creator","@mashable"],["twitter:card","photo"],["twitter:image:width","560"],["twitter:image:height","750"],["date","2016-04-01 23:26:01 UTC"],["sailthru.author","Brian Ries"],["sailthru.image.thumb","http://rack.2.mshcdn.com/media/ZgkyMDE2LzA0LzAxL2QzL3Nob290ZXIuNmJjOTMuanBnCnAJdGh1bWIJMTE1eDExNSMKZQlqcGc/7f31eddf/9f6/shooter.jpg"],["sailthru.image.full","http://rack.3.mshcdn.com/media/ZgkyMDE2LzA0LzAxL2QzL3Nob290ZXIuNmJjOTMuanBnCnAJdGh1bWIJOTUweDUzNCMKZQlqcGc/8f2db68b/9f6/shooter.jpg"],["sailthru.lead_image","http://rack.1.mshcdn.com/media/ZgkyMDE2LzA0LzAxL2QzL3Nob290ZXIuNmJjOTMuanBnCnAJdGh1bWIJNjAweDMzOCMKZQlqcGc/238675fe/9f6/shooter.jpg"],["sailthru.secondary_image","http://rack.3.mshcdn.com/media/ZgkyMDE2LzA0LzAxL2QzL3Nob290ZXIuNmJjOTMuanBnCnAJdGh1bWIJMjg4eDE2MiMKZQlqcGc/6a8e55f0/9f6/shooter.jpg"],["sailthru.exclude_homepage",false],["sailthru.exclude_uk",false],["sailthru.exclude_australia",false],["sailthru.exclude_india",false],["author","Brian Ries"]],"short_url":[["short_url","http://on.mash.to/1pSuJjr"]]}; </script> <div class="right_rail_replace"> <div class="ad_container ad-slot" data-overrides='{"targeting":{"tile":1,"adnum":1,"sec0":"world","sec1":"us","sec2":"posts","topic":"facebook"}}' data-type="no_right_rail"> </div> </div> </article> </div> <div class="article-comments limit-comments"> <div data-article-id="56ff03c4b05f9d2bb4000215" data-checksum="a304b61e253fa3b46405b2982c4b3b01" data-collection-meta="eyJ0eXAiOiJKV1QiLCJhbGciOiJIUzI1NiJ9.eyJ0aXRsZSI6IkNoaWNhZ28gbWFuIGFwcGVhcnMgdG8gc3RyZWFtIGhpcyBvd24gc2hvb3Rpbmcgb24gRmFjZWJvb2siLCJ1cmwiOiJodHRwOi8vbWFzaGFibGUuY29tLzIwMTYvMDQvMDEvZmFjZWJvb2stbGl2ZS1zaG9vdGluZy8iLCJ0YWdzIjoiY2hpY2FnbyxzaG9vdGluZyxmYWNlYm9vay1saXZlLGZhY2Vib29rLHdvcmxkIiwiY2hlY2tzdW0iOiJhMzA0YjYxZTI1M2ZhM2I0NjQwNWIyOTgyYzRiM2IwMSIsImFydGljbGVJZCI6IjU2ZmYwM2M0YjA1ZjlkMmJiNDAwMDIxNSJ9.2aWnePLzQN_HvfxKWfFr5B6Zoaf-4aje62-qKuGhhjc" data-network="mashable.fyre.co" data-root="zor.livefyre.com" data-site-id="312274" id="livefyre_comments"> </div> <a class="btn btn-light load-comments" href="#"> Load Comments </a> </div> </div> </div> <aside class="box-cell sidebar"> <div class="ad sidebar-inset sidebar-drop"> <div class="ad_container ad-slot" data-overrides='{"targeting":{"tile":2,"adnum":1,"sec0":"world","sec1":"us","sec2":"posts","topic":"facebook"}}' data-type="right_rail"> </div> </div> <h1 class="ribbon hot"> What's Hot </h1> <div class="sidebar-inset" id="big-stories"> </div> </aside> </div> <div id="more-in-channel"> <div class="page-header channel" data-channel="world" data-section="sec0=world&sec1=index&sec2="> <h2> More in World </h2> </div> <div class="fixable-wrapper" id="column-headers"> <div class="column-headers"> <div class="headers"> <div class="header column1 waypoint" data-fixselector="header.fixable"> <a data-short="New" href="#"> <em> What's New </em> </a> </div> <div class="header column2 waypoint" data-fixselector="header.fixable"> <a data-short="Rising" href="#"> <em> What's Rising </em> </a> </div> <div class="header column3 waypoint" data-fixselector="header.fixable"> <a data-short="Hot" href="#"> <em> What's Hot </em> </a> </div> </div> </div> </div> <div class="slide-window"> <div class="flex-box columns"> <section class="column box-cell new-stories" id="column-new"> <h1 class="semantic"> What's New </h1> <div class="column-content"> </div> </section> <section class="column box-cell hot-stories" id="column-rising"> <h1 class="semantic"> What's Rising </h1> <div class="column-content"> </div> </section> <section class="column box-cell big-stories" id="column-hot"> <h1 class="semantic"> What's Hot </h1> <div class="column-content"> </div> </section> </div> </div> </div> <script> (function(){ loadScriptAsync("//platform.twitter.com/oct.js", "twitteroct") var timer; timer = every(500, function() { if ((typeof twttr !== "undefined" && twttr !== null) && (twttr.conversion != null)) { clearInterval(timer); return twttr.conversion.trackPid('l4o6d'); } }); }()); </script> <noscript> <img alt="" height="1" src="https://analytics.twitter.com/i/adsct?txn_id=l4o6d&p_id=Twitter" style="display:none;" width="1"> <img alt="" height="1" src="//t.co/i/adsct?txn_id=l4o6d&p_id=Twitter" style="display:none;" width="1"> </img> </img> </noscript> </img> </div> </div> </div> <div id="fb-root"> </div> <script> if(window.initPage) { window.initPage() } else { $(function() { window.initPage(); })} </script> </div> <footer id="site-footer-wrapper"> <div class="page-container" id="site-footer"> <ul class="nav"> <li> <a href="/about/"> About Us </a> </li> <li> <a href="http://findjobs.mashable.com"> Jobs </a> </li> <li> <a href="/advertise/"> Advertise </a> </li> <li> <a href="/2011/05/09/connect-with-mashable/"> Subscribe </a> </li> <li> <a href="/privacy/"> Privacy </a> </li> <li> <a href="/terms/"> Terms </a> </li> </ul> <ul class="social"> <li> <a class="facebook" href="http://www.facebook.com/mashable/" target="_social"> </a> </li> <li> <a class="twitter" href="https://twitter.com/mashable" target="_social"> </a> </li> <li> <a class="gplus" href="https://plus.google.com/+Mashable" target="_social"> </a> </li> <li> <a class="rss" href="http://feeds.mashable.com/Mashable" target="_social"> </a> </li> <li> <a class="pinterest" href="http://pinterest.com/mashable/" target="_social"> </a> </li> <li> <a class="youtube" href="http://www.youtube.com/user/mashable" target="_social"> </a> </li> <li> <a class="stumbleupon" href="http://www.stumbleupon.com/channel/Mashable" target="_social"> </a> </li> <li> <a class="linkedin" href="http://www.linkedin.com/today/mashable.com" target="_social"> </a> </li> </ul> <div class="about"> <a class="brand" href="/"> Mashable </a> <span class="blurb"> is a global, multi-platform media and entertainment company. Powered by its own proprietary technology, Mashable is the go-to source for tech, digital culture and entertainment content for its dedicated and influential audience around the globe. </span> </div> <ul class="copyright-and-legal"> <li> ©2005-2016 Mashable, Inc. </li> <li> Reproduction without explicit permission is prohibited. All Rights Reserved. </li> <li> Designed in collaboration with <a href="http://www.codeandtheory.com" rel="nofollow"> Code & Theory </a> </li> </ul> </div> </footer> <noscript> <img src="http://b.scorecardresearch.com/p?c1=2&c2=8750086&cv=2.0&cj=1"> </img> </noscript> </div> </div> <script> window.detectStaffEditableLink(); </script> </body> </html>
title = soup.title.string
title
'Chicago man appears to stream his own shooting on Facebook'
author = soup.find_all("span", { "class" : "author_name"})
author
[<span class="author_name">By Brian Ries</span>]
# If author is empty try this:
if author == []:
author = soup.find_all("span", { "class" : "byline basic"})
author
[<span class="author_name">By Brian Ries</span>]
str(author).split('>')
['[<span class="author_name"', 'By Brian Ries</span', ']']
author = str(author).split('>')[1]
author
'By Brian Ries</span'
author = author.split('By ')[1]
author
'Brian Ries</span'
author = author.split('<')[0]
author
'Brian Ries'
shares = soup.find_all("div", { "class" : "total-shares"})
shares
[<div class="total-shares" data-index="0"> <em>1.5k</em> <div class="caption">Shares</div> </div>]
shares = str(shares).split('<em>')[1].split('</em>')[0]
shares
'1.5k'
if 'k' in shares:
shares = shares[:-1]
shares = shares.replace('.', '') + '00'
shares
'1500'
author_web = soup.find_all("a", { "class" : "byline"})
author_web
[<a class="byline " href="/people/moneyries/"><img alt="Headshot_2015_brianries_updatedshot_1" class="author_image" src="http://rack.0.mshcdn.com/media/ZgkyMDE1LzA2LzIyLzBjL0hlYWRzaG90XzIwLjdiMmE5LmpwZwpwCXRodW1iCTkweDkwIwplCWpwZw/e4aef619/c0c/Headshot_2015_BrianRies_UpdatedShot_1.jpg"/><div class="author_and_date"><span class="author_name">By Brian Ries</span><time datetime="Fri, 01 Apr 2016 23:26:01 +0000">2016-04-01 23:26:01 UTC</time></div></a>]
if author_web != []:
author_web = str(author_web).split('href="')[1]
author_web
'/people/moneyries/"><img alt="Headshot_2015_brianries_updatedshot_1" class="author_image" src="http://rack.0.mshcdn.com/media/ZgkyMDE1LzA2LzIyLzBjL0hlYWRzaG90XzIwLjdiMmE5LmpwZwpwCXRodW1iCTkweDkwIwplCWpwZw/e4aef619/c0c/Headshot_2015_BrianRies_UpdatedShot_1.jpg"/><div class="author_and_date"><span class="author_name">By Brian Ries</span><time datetime="Fri, 01 Apr 2016 23:26:01 +0000">2016-04-01 23:26:01 UTC</time></div></a>]'
if author_web != []:
author_web = author_web.split('">')[0]
author_web
'/people/moneyries/'
if author_web != []:
author_web = 'http://mashable.com' + author_web
author_web
'http://mashable.com/people/moneyries/'
# Donde empieza y donde termina el texto
temp = str(soup)[str(soup).find('class="author_and_date"'):]
temp = temp[:temp.find('class="article-topics"')]
temp
'class="author_and_date"><span class="author_name">By Brian Ries</span><time datetime="Fri, 01 Apr 2016 23:26:01 +0000">2016-04-01 23:26:01 UTC</time></div></a></div>\n</header>\n<section class="article-content blueprint">\n<div class="post-text">\n<p>I guess it was only a matter of time.</p>\n<p>Chicago Police are investigating an extraordinary video that appears to capture the shooting of a man while he was streaming on Facebook Live.</p>\n<h2 class="h2">Watch the video (graphic content):</h2>\n<div>\n<div id="fb-root"></div>\n<div class="fb-video" data-allowfullscreen="1" data-href="/marie.creamer.549/videos/vb.100007259195441/1671424763109481/?type=3"><div class="fb-xfbml-parse-ignore"><blockquote cite="https://www.facebook.com/marie.creamer.549/videos/1671424763109481/">\n<p><a href="https://www.facebook.com/marie.creamer.549/videos/1671424763109481/" target="_blank"></a></p>\n<p>Damn he \U000fe1b5 was on LIVE \U000fe4f9 talking \U000fe193 shit with no \U000fe351 burner \U000fe4f5 and got his \U000fe1b5 life took \U000fe1b3\U000fe1af smds shit crazy \U000fe341\U000fe340\U000fe35b\U000feb7b . #LITERALLY</p>\n<p>Posted by <a href="#" role="button" target="_blank">TcWorld Creamer</a> on Thursday, March 31, 2016</p>\n</blockquote></div></div>\n</div>\n<p>In the clip, which was re-recorded from its original source on Thursday and disseminated widely, a man in a blue Chicago White Sox hat is seen talking into the camera while standing in front of Scott\'s Convenience Store in Chicago\'s West Englewood neighborhood.</p>\n<p>He jokes that the store is open because he needed "somewhere to duck and hide for cover."</p>\n<figure class="image"><p><img alt="Scott\'s Convenience Store is seen in the Facebook video and on Google Street View." class="" data-caption="Scott\'s Convenience Store is seen in the Facebook video and on Google Street View." data-credit-name="google/facebook" data-credit-provider="custom type" data-fragment="m!5acd" data-image="http://rack.3.mshcdn.com/media/ZgkyMDE2LzA0LzAxLzQzL0NoaWNhZ29fRmFjLjUyN2M4LmpwZwpwCXRodW1iCTEyMDB4OTYwMD4/f6f0d8ab/35f/Chicago_Facebook_Shooting.jpg" data-micro="1" data-width="999" src="http://rack.3.mshcdn.com/media/ZgkyMDE2LzA0LzAxLzQzL0NoaWNhZ29fRmFjLjUyN2M4LmpwZwpwCXRodW1iCTEyMDB4OTYwMD4/f6f0d8ab/35f/Chicago_Facebook_Shooting.jpg"/></p>\n<figcaption class="image-caption"><p>Scott\'s Convenience Store is seen in the Facebook video and on Google Street View.</p></figcaption><div class="image-credit"><p>Image: google/facebook</p></div></figure><p><span style="line-height: 1.5;">Moments later, shots ring out and the phone drops to the street, camera up. The apparent assailant, wearing red, then steps into the frame and continues firing the gun elsewhere.</span></p>\n<p>A minute passes and a woman begins screaming,\xa0“Oh my God, no! I can’t believe this."</p>\n<p>While many people have questioned the video\'s authenticity, especially as it surfaced in the hours before April Fools\' Day, Chicago Police say it\'s likely legitimate.</p>\n<p>"CPD is aware of the social media video in question and suspect the video is connected to the incident," Officer Kevin Quaid, with the Office of News Affairs, told <i>Mashable.\xa0</i></p>\n<div class="see-also move-option" contenteditable="false"><p>SEE ALSO: <a data-crackerjax="#post-slider" href="http://mashable.com/2016/03/19/john-vachon-chicago/">1941 Chicago streets through the lens of a rookie FSA photographer</a></p></div>\n<p>He added\xa0that\xa0detectives were working to confirm its authenticity, but that a man, 31, was shot on Thursday at the location seen in the video and transported to Mount Sinai hospital in critical condition.</p>\n<p>Detectives are waiting to speak with the apparent victim, who is now under sedation, The Associated Press reported.</p>\n<p>The victim is believed to be a known gang member.</p>\n<p>Peter Nickeas, a <i>Chicago Tribune</i> reporter who wrote about the video, <a href="https://twitter.com/PeterNickeas/status/715745669386997760" target="_blank">tweeted</a>\xa0that police are privately a lot more confident than their official statements suggest.</p>\n<div class="twitter-wrapper sort-rerender"><div><blockquote class="twitter-tweet">\n<p dir="ltr" lang="en">Video is probably real but important (essential, IMO) to make sure it\'s real, not just that it couldn\'t conceivably be fake.</p>\n<p>— Peter Nickeas (@PeterNickeas) <a href="https://twitter.com/PeterNickeas/status/715738986057216001" target="_blank">April 1, 2016</a></p>\n</blockquote></div></div>\n<p><span style="line-height: 1.5;">"Video is probably real but important (essential, IMO) to make sure it\'s real, not just that it couldn\'t conceivably be fake," he said. "Police are privately more confident (a lot more) in the video\'s authenticity than the CPD news affairs statement lets on."</span></p>\n<p>If it proves to be real, this would probably be a first for the live video product Facebook CEO Mark Zuckerberg is <a href="http://recode.net/2016/02/26/mark-zuckerberg-is-obsessed-with-livestreaming-making-live-a-top-priority-at-facebook/" target="_blank">reportedly</a> "obsessed" with.</p>\n<p>The shocking video comes as numerous news organizations have embraced the medium, which has been used to stream live scenes from protests, political events and average life.</p>\n<p>Violence in Chicago is reaching levels "unseen in years," <a href="http://www.chicagotribune.com/news/ct-chicago-homicides-first-quarter-met-20160330-story.html" target="_blank">according to the <i>Tribune</i></a><i></i>, with shootings up\xa073% over this time last year.\xa0<span style="line-height: 1.5;">More than 700 people have been shot in the year\'s first quarter.</span></p>\n<p><span style="line-height: 1.5;">The suspected shooter in Thursday\'s incident is still at large.</span></p>\n<p contenteditable="false"><em>Have something to add to this story? Share it in the comments.</em></p>\n</div>\n<script> window._msla=window.loadScriptAsync||function(src,id){if(document.getElementById(id))return;var js=document.createElement(\'script\');js.id=id;js.src=src;document.getElementsByTagName(\'script\')[0].parentNode.insertBefore(js,fjs);};\n_msla("//connect.facebook.net/en_US/sdk.js#xfbml=1&version=v2.3","facebook-jssdk");_msla("//platform.twitter.com/widgets.js","twitter_jssdk");</script>\n</section><div class="fb-quote"></div><section class="branded-content">\n</section>\n<footer '
# ytp-thumbnail-overlay ytp-cued-thumbnail-overlay
videos = []
index = 0
while index < len(temp):
index = temp.find('https://www.youtube.com', index)
if index == -1:
break
videos.append(temp[index:index+100].split('"')[0])
index += 2
index = 0
while index < len(temp):
index = temp.find('div class="fb-video" data-allowfullscreen="1" data-href=', index)
if index == -1:
break
videos.append('http://facebook.com' + (temp[index:index+1000].split('"><div class="fb')[0].split('data-href="')[1]))
index += 2
videos
['http://facebook.com/marie.creamer.549/videos/vb.100007259195441/1671424763109481/?type=3']
len(videos)
1
print(soup.get_text())
window.__o = {"channel":"world","content_type":"article","v_buy":null,"v_buy_i":null,"h_pub":16.0,"h_buy":null,"h_pub_buy":null,"v_cur":0.1,"v_max":0.1,"v_cur_i":0,"v_max_i":0,"events":"event51,event61","top_channel":"world","content_source_type":"Internal","content_source_name":"Internal","author_name":"Brian Ries","age":"0","pub_day":1,"pub_month":4,"pub_year":2016,"pub_date":"04/01/2016","sourced_from":"Internal","isPostView":true,"post_lead_type":"Alt Image Lead","topics":"Chicago,Facebook,facebook live,shooting,World","campaign":null,"display_mode":null,"viral_video_type":null,"b_flag":false}; window._gaq = window._gaq || []; window._gaq.push(['_setAccount', 'UA-92124-1']); window._geo = "US"; window.__domStart = (new Date().getTime()) Chicago man appears to stream his own shooting on Facebook {"@context":"http://schema.org","headline":"Chicago man appears to stream his own shooting on Facebook","url":"http://mashable.com/2016/04/01/facebook-live-shooting/","image":"http://rack.3.mshcdn.com/media/ZgkyMDE2LzA0LzAxL2QzL3Nob290ZXIuYWQwNjUuanBnCnAJdGh1bWIJMTIwMHg2MjcjCmUJanBn/764bc2c7/1d6/shooter.jpg","keywords":["chicago","shooting","facebook-live","facebook","world"],"@type":"Article","dateCreated":"2016-04-01T23:26:01Z","datePublished":"2016-04-01T23:26:01Z","articleSection":"world","creator":"Brian Ries","author":"Brian Ries","mainEntityOfPage":"True","metadata":{"page":1,"omnitureData":{"channel":"world","content_type":"article","v_buy":null,"v_buy_i":null,"h_pub":16.0,"h_buy":null,"h_pub_buy":null,"v_cur":0.1,"v_max":0.1,"v_cur_i":0,"v_max_i":0,"events":"event51,event61","top_channel":"world","content_source_type":"Internal","content_source_name":"Internal","author_name":"Brian Ries","age":"0","pub_day":1,"pub_month":4,"pub_year":2016,"pub_date":"04/01/2016","sourced_from":"Internal","isPostView":true,"post_lead_type":"Alt Image Lead","topics":"Chicago,Facebook,facebook live,shooting,World","campaign":null,"display_mode":null,"viral_video_type":null,"b_flag":false},"postId":null}} !function(f,b,e,v,n,t,s){if(f.fbq)return;n=f.fbq=function(){n.callMethod? n.callMethod.apply(n,arguments):n.queue.push(arguments)};if(!f._fbq)f._fbq=n; n.push=n;n.loaded=!0;n.version='2.0';n.queue=[];t=b.createElement(e);t.async=!0; t.src=v;s=b.getElementsByTagName(e)[0];s.parentNode.insertBefore(t,s)}(window, document,'script','//connect.facebook.net/en_US/fbevents.js'); fbq('init', '1453039084979896'); fbq('track', "PageView"); Mashable We're using cookies to improve your experience. Click Here to find out more. Mashable Mashable Asia Mashable Australia Mashable France Mashable India Mashable UK Sign in Like Follow Follow Mashable see more > Search Videos Social Media Tech Business Entertainment World Lifestyle Watercooler Shop More Channels Videos Social Media Tech Business Entertainment World Lifestyle Watercooler Shop CompanyAbout UsLicensing & ReprintsArchiveMashable Careers ContactContact UsSubmit News AdvertiseAdvertise LegalPrivacy PolicyTerms of UseCookie Policy AppsiPhone / iPadAndroid ResourcesSubscriptions SitesMashable ShopJob BoardSocial Good SummitMedia Summit World Like Follow Follow Chicago man appears to stream his own shooting on Facebook 1.5k Shares Share Tweet Share What's This? A man is seen firing a gun in a Facebook Live video reportedly taken in Chicago.Image: Facebook By Brian Ries2016-04-01 23:26:01 UTC I guess it was only a matter of time. Chicago Police are investigating an extraordinary video that appears to capture the shooting of a man while he was streaming on Facebook Live. Watch the video (graphic content): Damn he was on LIVE talking shit with no burner and got his life took smds shit crazy . #LITERALLY Posted by TcWorld Creamer on Thursday, March 31, 2016 In the clip, which was re-recorded from its original source on Thursday and disseminated widely, a man in a blue Chicago White Sox hat is seen talking into the camera while standing in front of Scott's Convenience Store in Chicago's West Englewood neighborhood. He jokes that the store is open because he needed "somewhere to duck and hide for cover." Scott's Convenience Store is seen in the Facebook video and on Google Street View.Image: google/facebookMoments later, shots ring out and the phone drops to the street, camera up. The apparent assailant, wearing red, then steps into the frame and continues firing the gun elsewhere. A minute passes and a woman begins screaming, “Oh my God, no! I can’t believe this." While many people have questioned the video's authenticity, especially as it surfaced in the hours before April Fools' Day, Chicago Police say it's likely legitimate. "CPD is aware of the social media video in question and suspect the video is connected to the incident," Officer Kevin Quaid, with the Office of News Affairs, told Mashable. SEE ALSO: 1941 Chicago streets through the lens of a rookie FSA photographer He added that detectives were working to confirm its authenticity, but that a man, 31, was shot on Thursday at the location seen in the video and transported to Mount Sinai hospital in critical condition. Detectives are waiting to speak with the apparent victim, who is now under sedation, The Associated Press reported. The victim is believed to be a known gang member. Peter Nickeas, a Chicago Tribune reporter who wrote about the video, tweeted that police are privately a lot more confident than their official statements suggest. Video is probably real but important (essential, IMO) to make sure it's real, not just that it couldn't conceivably be fake. — Peter Nickeas (@PeterNickeas) April 1, 2016 "Video is probably real but important (essential, IMO) to make sure it's real, not just that it couldn't conceivably be fake," he said. "Police are privately more confident (a lot more) in the video's authenticity than the CPD news affairs statement lets on." If it proves to be real, this would probably be a first for the live video product Facebook CEO Mark Zuckerberg is reportedly "obsessed" with. The shocking video comes as numerous news organizations have embraced the medium, which has been used to stream live scenes from protests, political events and average life. Violence in Chicago is reaching levels "unseen in years," according to the Tribune, with shootings up 73% over this time last year. More than 700 people have been shot in the year's first quarter. The suspected shooter in Thursday's incident is still at large. Have something to add to this story? Share it in the comments. window._msla=window.loadScriptAsync||function(src,id){if(document.getElementById(id))return;var js=document.createElement('script');js.id=id;js.src=src;document.getElementsByTagName('script')[0].parentNode.insertBefore(js,fjs);}; _msla("//connect.facebook.net/en_US/sdk.js#xfbml=1&version=v2.3","facebook-jssdk");_msla("//platform.twitter.com/widgets.js","twitter_jssdk"); Topics: Chicago, Facebook, facebook live, shooting, World Image: Facebook if(window.pageChanged) window.omni({"channel":"world","content_type":"article","v_buy":null,"v_buy_i":null,"h_pub":16.0,"h_buy":null,"h_pub_buy":null,"v_cur":0.1,"v_max":0.1,"v_cur_i":0,"v_max_i":0,"events":"event51,event61","top_channel":"world","content_source_type":"Internal","content_source_name":"Internal","author_name":"Brian Ries","age":"0","pub_day":1,"pub_month":4,"pub_year":2016,"pub_date":"04/01/2016","sourced_from":"Internal","isPostView":true,"post_lead_type":"Alt Image Lead","topics":"Chicago,Facebook,facebook live,shooting,World","campaign":null,"display_mode":null,"viral_video_type":null,"b_flag":false}); metaData = {"link":[["canonical","http://mashable.com/2016/04/01/facebook-live-shooting/"],["image_src","http://rack.3.mshcdn.com/media/ZgkyMDE2LzA0LzAxL2QzL3Nob290ZXIuYWQwNjUuanBnCnAJdGh1bWIJMTIwMHg2MjcjCmUJanBn/764bc2c7/1d6/shooter.jpg"]],"meta_property":[["og:url","http://mashable.com/2016/04/01/facebook-live-shooting/"],["og:title","Chicago man appears to stream his own shooting on Facebook"],["og:type","article"],["og:site_name","Mashable"],["og:description","Chicago Police are investigating an extraordinary video that appears to capture the shooting of a man while he was streaming on Facebook Live."],["og:image","http://rack.0.mshcdn.com/media/ZgkyMDE2LzA0LzAxL2QzL3Nob290ZXIuYWQwNjUuanBnCnAJdGh1bWIJMTIwMHg2MzAKZQlqcGc/13367dc7/1d6/shooter.jpg"],["og:article:published_time","2016-04-01T23:26:01Z"],["og:article:modified_time","2016-04-01T23:45:00Z"],["og:article:publisher","https://www.facebook.com/mashable"]],"meta_name":[["description","Chicago Police are investigating an extraordinary video that appears to capture the shooting of a man while he was streaming on Facebook Live."],["keywords","chicago, shooting, facebook-live, facebook, world"],["twitter:title","Chicago man appears to stream his own shooting on Facebook"],["twitter:description","I guess it was only a matter of time.\n"],["twitter:image","http://rack.0.mshcdn.com/media/ZgkyMDE2LzA0LzAxL2QzL3Nob290ZXIuYWQwNjUuanBnCnAJdGh1bWIJNTYweDc1MAplCWpwZw/5cd68b1a/1d6/shooter.jpg"],["twitter:site","@mashable"],["twitter:via","mashable"],["twitter:url","http://mashable.com/2016/04/01/facebook-live-shooting/"],["twitter:creator","@mashable"],["twitter:card","photo"],["twitter:image:width","560"],["twitter:image:height","750"],["date","2016-04-01 23:26:01 UTC"],["sailthru.author","Brian Ries"],["sailthru.image.thumb","http://rack.2.mshcdn.com/media/ZgkyMDE2LzA0LzAxL2QzL3Nob290ZXIuNmJjOTMuanBnCnAJdGh1bWIJMTE1eDExNSMKZQlqcGc/7f31eddf/9f6/shooter.jpg"],["sailthru.image.full","http://rack.3.mshcdn.com/media/ZgkyMDE2LzA0LzAxL2QzL3Nob290ZXIuNmJjOTMuanBnCnAJdGh1bWIJOTUweDUzNCMKZQlqcGc/8f2db68b/9f6/shooter.jpg"],["sailthru.lead_image","http://rack.1.mshcdn.com/media/ZgkyMDE2LzA0LzAxL2QzL3Nob290ZXIuNmJjOTMuanBnCnAJdGh1bWIJNjAweDMzOCMKZQlqcGc/238675fe/9f6/shooter.jpg"],["sailthru.secondary_image","http://rack.3.mshcdn.com/media/ZgkyMDE2LzA0LzAxL2QzL3Nob290ZXIuNmJjOTMuanBnCnAJdGh1bWIJMjg4eDE2MiMKZQlqcGc/6a8e55f0/9f6/shooter.jpg"],["sailthru.exclude_homepage",false],["sailthru.exclude_uk",false],["sailthru.exclude_australia",false],["sailthru.exclude_india",false],["author","Brian Ries"]],"short_url":[["short_url","http://on.mash.to/1pSuJjr"]]}; Load Comments What's Hot More in World What's New What's Rising What's Hot What's New What's Rising What's Hot (function(){ loadScriptAsync("//platform.twitter.com/oct.js", "twitteroct") var timer; timer = every(500, function() { if ((typeof twttr !== "undefined" && twttr !== null) && (twttr.conversion != null)) { clearInterval(timer); return twttr.conversion.trackPid('l4o6d'); } }); }()); if(window.initPage) { window.initPage() } else { $(function() { window.initPage(); })} About UsJobsAdvertiseSubscribePrivacyTerms Mashable is a global, multi-platform media and entertainment company. Powered by its own proprietary technology, Mashable is the go-to source for tech, digital culture and entertainment content for its dedicated and influential audience around the globe. ©2005-2016 Mashable, Inc. Reproduction without explicit permission is prohibited. All Rights Reserved. Designed in collaboration with Code & Theory window.detectStaffEditableLink();
try:
text = str(soup.get_text()).split("UTC\n\n\n")[1]
except IndexError:
text = str(soup.get_text()).split("Analysis\n\n")[1]
text = text.split('Have something to add to this story?')[0]
print(text)
I guess it was only a matter of time. Chicago Police are investigating an extraordinary video that appears to capture the shooting of a man while he was streaming on Facebook Live. Watch the video (graphic content): Damn he was on LIVE talking shit with no burner and got his life took smds shit crazy . #LITERALLY Posted by TcWorld Creamer on Thursday, March 31, 2016 In the clip, which was re-recorded from its original source on Thursday and disseminated widely, a man in a blue Chicago White Sox hat is seen talking into the camera while standing in front of Scott's Convenience Store in Chicago's West Englewood neighborhood. He jokes that the store is open because he needed "somewhere to duck and hide for cover." Scott's Convenience Store is seen in the Facebook video and on Google Street View.Image: google/facebookMoments later, shots ring out and the phone drops to the street, camera up. The apparent assailant, wearing red, then steps into the frame and continues firing the gun elsewhere. A minute passes and a woman begins screaming, “Oh my God, no! I can’t believe this." While many people have questioned the video's authenticity, especially as it surfaced in the hours before April Fools' Day, Chicago Police say it's likely legitimate. "CPD is aware of the social media video in question and suspect the video is connected to the incident," Officer Kevin Quaid, with the Office of News Affairs, told Mashable. SEE ALSO: 1941 Chicago streets through the lens of a rookie FSA photographer He added that detectives were working to confirm its authenticity, but that a man, 31, was shot on Thursday at the location seen in the video and transported to Mount Sinai hospital in critical condition. Detectives are waiting to speak with the apparent victim, who is now under sedation, The Associated Press reported. The victim is believed to be a known gang member. Peter Nickeas, a Chicago Tribune reporter who wrote about the video, tweeted that police are privately a lot more confident than their official statements suggest. Video is probably real but important (essential, IMO) to make sure it's real, not just that it couldn't conceivably be fake. — Peter Nickeas (@PeterNickeas) April 1, 2016 "Video is probably real but important (essential, IMO) to make sure it's real, not just that it couldn't conceivably be fake," he said. "Police are privately more confident (a lot more) in the video's authenticity than the CPD news affairs statement lets on." If it proves to be real, this would probably be a first for the live video product Facebook CEO Mark Zuckerberg is reportedly "obsessed" with. The shocking video comes as numerous news organizations have embraced the medium, which has been used to stream live scenes from protests, political events and average life. Violence in Chicago is reaching levels "unseen in years," according to the Tribune, with shootings up 73% over this time last year. More than 700 people have been shot in the year's first quarter. The suspected shooter in Thursday's incident is still at large.
# Only if author_web != []:
from IPython.display import IFrame
IFrame(author_web, 600, 600)
Binary features if author is on: Facebook, LinkedIn, Twitter, Google+
author_networks = {'facebo': '',
'linked': '',
'twitte': '',
'google': ''}
response = urllib.request.urlopen(author_web)
html = response.read()
soup = BeautifulSoup(html, 'html.parser')
networks = soup.find_all("div", { "class" : "profile-networks"})
networks
[<div class="profile-networks"> <a class="network-badge network-badge-facebook network-badge-round" href="https://www.facebook.com/brianries" target="_blank"></a> <a class="network-badge network-badge-linkedin network-badge-round" href="http://www.linkedin.com/in/briankries" target="_blank"></a> <a class="network-badge network-badge-round network-badge-twitter" href="https://twitter.com/moneyries" target="_blank"></a> <a class="network-badge network-badge-google network-badge-round" href="https://plus.google.com/+BrianRiesAtMashable?rel=author" target="_blank"></a> </div>]
networks = str(networks).replace('network-badge-round', '')
networks
'[<div class="profile-networks">\n<a class="network-badge network-badge-facebook " href="https://www.facebook.com/brianries" target="_blank"></a>\n<a class="network-badge network-badge-linkedin " href="http://www.linkedin.com/in/briankries" target="_blank"></a>\n<a class="network-badge network-badge-twitter" href="https://twitter.com/moneyries" target="_blank"></a>\n<a class="network-badge network-badge-google " href="https://plus.google.com/+BrianRiesAtMashable?rel=author" target="_blank"></a>\n</div>]'
networks = networks.split('network-badge-')
networks # Note networks is now a list of strings
['[<div class="profile-networks">\n<a class="network-badge ', 'facebook " href="https://www.facebook.com/brianries" target="_blank"></a>\n<a class="network-badge ', 'linkedin " href="http://www.linkedin.com/in/briankries" target="_blank"></a>\n<a class="network-badge ', 'twitter" href="https://twitter.com/moneyries" target="_blank"></a>\n<a class="network-badge ', 'google " href="https://plus.google.com/+BrianRiesAtMashable?rel=author" target="_blank"></a>\n</div>]']
for network in networks:
if network[:6] in author_networks.keys():
author_networks[network[:6]] = network.split('href="')[1].split('" target')[0]
author_networks
{'facebo': 'https://www.facebook.com/brianries', 'google': 'https://plus.google.com/+BrianRiesAtMashable?rel=author', 'linked': 'http://www.linkedin.com/in/briankries', 'twitte': 'https://twitter.com/moneyries'}
author_networks['twitter_followers'] = 0
author_networks['twitte']
'https://twitter.com/moneyries'
response = urllib.request.urlopen(author_networks['twitte'])
html = response.read()
soup = BeautifulSoup(html, 'html.parser')
followers = str(soup.find_all("span", { "class" : "ProfileNav-value"})[2])
followers
'<span class="ProfileNav-value" data-is-compact="true">17,5\xa0K</span>'
followers = followers.split('">')[1]
followers
'17,5\xa0K</span>'
if ('K' in followers) or ('mil' in followers):
followers = followers.split('\xa0')[0]
if ',' in followers:
followers = followers.replace(',', '') + '00'
else:
followers = followers + '000'
else:
followers = followers.split('</span')[0].replace('.', '')
followers = int(followers)
followers
17500
author_networks['twitter_followers'] = followers
def news_info(url):
# Download HTML
response = urllib.request.urlopen(url_)
html = response.read()
soup = BeautifulSoup(html, 'html.parser')
# Title, author, text
title = soup.title.string
author = soup.find_all("span", { "class" : "author_name"})
# If author is empty try this:
if author == []:
author = soup.find_all("span", { "class" : "byline basic"})
author = str(author).split('>')[1].split('By ')[1].split('<')[0]
# Number of shares
shares = soup.find_all("div", { "class" : "total-shares"})
shares = str(shares).split('<em>')[1].split('</em>')[0]
if 'k' in shares:
shares = shares[:-1]
shares = shares.replace('.', '') + '00'
# Get text
try:
text = str(soup.get_text()).split("UTC\n\n\n")[1]
except IndexError:
text = str(soup.get_text()).split("Analysis\n\n")[1]
text = text.split('Have something to add to this story?')[0]
author_web = soup.find_all("a", { "class" : "byline"})
if author_web != []:
author_web = 'http://mashable.com' + str(author_web).split('href="')[1].split('">')[0]
# Author networks
author_networks = {'facebo': '',
'linked': '',
'twitte': '',
'google': ''}
response = urllib.request.urlopen(author_web)
html = response.read()
soup = BeautifulSoup(html, 'html.parser')
networks = str(soup.find_all("div", { "class" : "profile-networks"})).replace('network-badge-round', '').split('network-badge-')
for network in networks:
if network[:6] in author_networks.keys():
author_networks[network[:6]] = network.split('href="')[1].split('" target')[0]
# Author twitter followers
author_networks['twitter_followers'] = 0
if author_networks['twitte'] != '':
response = urllib.request.urlopen(author_networks['twitte'])
html = response.read()
soup = BeautifulSoup(html, 'html.parser')
followers = str(soup.find_all("span", { "class" : "ProfileNav-value"})[2]).split('">')[1]
if ('K' in followers) or ('mil' in followers):
followers = followers.split('\xa0')[0]
if ',' in followers:
followers = followers.replace(',', '') + '00'
else:
followers = followers + '000'
else:
followers = followers.split('</span')[0].replace('.', '')
author_networks['twitter_followers'] = int(followers)
else:
author_networks = {'facebo': '',
'linked': '',
'twitte': '',
'google': '',
'twitter_followers': 0}
return {'title': title, 'author': author, 'shares': shares,
'author_web': author_web, 'text':text,
'author_networks': author_networks}
url_ = 'http://mashable.com/2016/03/04/the-who-50th-anniversary'
news_info(url_)
{'author': 'Yohana Desta', 'author_networks': {'facebo': '', 'google': 'https://plus.google.com/102665910331841447889?rel=author', 'linked': '', 'twitte': 'https://twitter.com/YohanaDesta', 'twitter_followers': 2992}, 'author_web': 'http://mashable.com/people/yohana-desta/', 'shares': '762', 'text': '\nFifty years later, the Who can still rule a crowd.\nRoger Daltrey’s still got the howl and Pete Townshend can make the entirety of Madison Square Garden lose its mind over a swivel of his right arm. The band, currently on its 50th anniversary tour, packed Manhattan’s famed stadium on Wednesday night with thousands of fans eager to sing along to hits like “My Generation” and "Won\'t Get Fooled Again."\xa0\nThe show was even more celebratory because it was rescheduled from last fall, when Daltrey was diagnosed with viral meningitis. At the end of the show, he thanked the crowd for sticking around while he was "really having a tough time with the reaper."\n"Here were are, still standing," he said with a grin.\nSEE ALSO: Watch Lorde pay tribute to David Bowie (without an orange wig)\n\nRoger Daltrey at MSG on March 3.Image: Theo Wargo/Getty Images)Joan Jett and the Blackhearts opened the show, warming up a crowd that was still filing in well into the set. Jett is still a well-oiled performer, hitting all the right notes and delivering classics like “I Love Rock ’n’ Roll” and “I Hate Myself for Loving You" with her signature snarl.\nBefore the Who took the stage, numerous messages were posted on the giant screen, including one dedicated to David Bowie, that read: \n"Tonight, we will distinctly miss David Bowie, longtime fan of the Who."\n"Tonight, we will distinctly miss David Bowie, longtime fan of the Who. He’s told the story of how he climbed the fence at London’s Roundhouse to sneak backstage and give Pete Townshend a copy of his new 1969 album, David Bowie. He covered \'I Cant’ Explain\' and \'Anyway, Anyhow, Anywhere\' on his Pinups album. Nearly every year at MSG, he sat in the first row right beside the stage. We’ll miss our friend, a true icon of music and art, and a brilliant innovator.”\xa0\n\nlovely little tribute to David Bowie before the Who perform pic.twitter.com/2PEXOB5lv9\n— black hermione (@YohanaDesta) March 4, 2016\n\nSoon after, the Who took the stage, launching right into performances of "Who Are You," "The Seeker" and "The Kids Are Alright."\xa0\nThen, Townshend grabbed the mic, telling an anecdote about how the band\'s first show in the U.S. was in New York City, around 1967. However, the band wasn\'t a hit straightaway.\xa0\n"It took time for you f*ckin\' Americans to catch up," he joked to uproarious laughter.\xa0\nAnd with that, the band went into "I Can See for Miles" and "My Generation," the latter of which riled up the nostalgic, mostly older crowd. Speaking of nostalgia, lots of vintage footage and photographs served as the backdrop for different songs, amplifying the memory lane aspect of the tour.\xa0\n\nthen & now pic.twitter.com/o3wp57V4aM\n— black hermione (@YohanaDesta) March 4, 2016\n\nTownshend chatted with the crowd a bunch between songs, joking about how the Who weren\'t always perceived as rock\'n\'roll.\xa0\n"We were a boy band," he says. "We had pop songs."\nSo then he started playing "Pictures of Lily," which he considers "one of my favorite" pop tracks.\xa0\nWhen it came to obvious fan favorites, songs like "Behind Blue Eyes," "Pinball Wizard" and "Teenage Wasteland" ruled the night. However, the standout moments were the ones that allowed the band to flourish and flex some musical muscle.\xa0\n\nPete Townshend of the Who performs at Madison Square Garden on March 3.Image: Theo Wargo/Getty Images"The Rock," an instrumental number that Daltrey called a favorite, was one such moment, an ever-expanding jam full of delicious guitar solos, coupled with an ever-changing array of backdrop footage, from photos of the Vietnam War, to newspaper headlines about John Lennon\'s death, to footage of late drummer Keith Moon.\xa0\n"Love, Reign O\'er Me" was also a masterful performance, opening with a keyboard solo and descending into an 8-minute rock journey, accented with Daltrey\'s signature howls.\xa0\n\nThey wrapped with (what else?) "Baba O\'Riley" and "Won\'t Get Fooled Again."\xa0\nTownshend ended the night by introducing everyone in the band, dropping this funny little quip for drummer Zak Starkey.\xa0\n"I hate all drummers, basically, but this one\'s almost acceptable!" he joked.\xa0Starkey\'s dad, Ringo Starr, would probably appreciate that.\xa0\nThen Daltrey took the mic so Townshend could get some applause for himself, then shared some choice parting words. \xa0\n"Thanks for coming!" Daltrey said. "Be happy, be healthy ... [and] be lucky!"\xa0\n', 'title': 'The Who’s 50th anniversary MSG show was a nostalgic Rock ’n’ Roll trip'}
url_ = 'http://mashable.com/2016/03/08/scotland-giant-rabbit-home'
news_info(url_)
{'author': 'Davina Merchant', 'author_networks': {'facebo': '', 'google': 'https://plus.google.com/105525238342980116477?rel=author', 'linked': '', 'twitte': '', 'twitter_followers': 0}, 'author_web': 'http://mashable.com/people/568bdab3519840193100211f/', 'shares': '7000', 'text': 'LONDON - Last month we reported on a dog-sized rabbit in desperate need of a new home — now just under a month later Atlas the rabbit now has a permanent home. \nAfter his story went global people from all over the world, including the U.S., Canada and France started reaching out to the Scottish Society for the Prevention of Cruelty to Animals to re-home the rabbit. \nThanks to Jen Hislop from Ayrshire, the adorable bunny will get to stay in his native Scotland. \n\nHe even has a new buggy.Image: Facebook Scottish SPCAJen, a financial fraud investigator, told the charity, "I burst into tears when I got the phone call saying I had been chosen to re-home Atlas and I cried again when I collected him." \nThe 43-year-old, who previously had two giant bunnies, currently has a giant Rex rabbit named Coconut.\nSee also: Dog-sized rabbit looking for home \'still has growing to do\'\nAtlas new home has a summer house with heating and air-conditioning. He also has his own accommodation in a large garden enclosure as well as the run of the house.\n\nTo Jen, the rabbit was the perfect addition to her family and the only thing she changed about him was his name. Say hello to Atilla the Bun Binky Master Jazz Paws, but don\'t worry you can call "him Atty for short!"\n', 'title': 'Adorable dog-sized rabbit finally finds his forever home'}
url_ = 'http://mashable.com/2016/03/08/15-skills-digital-marketers'
news_info(url_)
{'author': 'Scott Gerber', 'author_networks': {'facebo': '', 'google': '', 'linked': '', 'twitte': '', 'twitter_followers': 0}, 'author_web': [], 'shares': '5000', 'text': 'Today\'s digital marketing experts must have a diverse skill set, including a sophisticated grasp of available media channels, the ability to identify up-and-coming opportunities, on top of having the basic skills of a brilliant marketer. What\'s more, they have to possess a balance of critical and creative thinking skills in order to drive measurable success for their company.\nThat\'s why I asked 15 members of Young Entrepreneur Council (YEC) what they look for when hiring digital marketers. Their best answers are below.\n1. Paid social media advertising expertise\n\nA new digital marketing hire should be well-versed in paid social media advertising, especially through Facebook or a similar social platform that our company uses regularly. They need to be able to understand and implement Facebook analytics and insights, create "lookalike" and custom audiences, experiment and test creative campaign and images, and be secure in their knowledge of the overall social media landscape. There are many budget-saving opportunities within the social media advertising space, so we want to make sure that our digital marketing talent knows the ins and outs of this popular and easy-to-implement marketing space. \n— Miles Jennings, Recruiter.com\nSEE ALSO: Web developers, data scientists, AI experts: The 15 top tech roles of 2016\n\n2. Sales skills\n\nWe\'ve hired many digital marketers over the years, both outsourced and in-house. What we\'ve found is that people who have sold successfully are much better marketers. They know how to engage with people and turn them into sales opportunities. While your digital marketers may not be closing deals directly, they need to know how to sell or they\'ll be wasting your valuable marketing dollars without generating qualified lead opportunities for your sales team. \n— Mark Cenicola, BannerView.com\n3. Specific marketing channel expertise \n\nI see so many marketers who extol the virtues of every conceivable marketing channel: email, SEO, SEM, social, etc. And many channels might work for you, but the key to a successful marketing strategy is focusing on a few channels and using them really well. Often that means understanding the dynamics of that marketing channel deeply and leveraging those dynamics for your specific company. For example, in helping local businesses, Pinterest is less interesting (although it\'s one of the best drivers of ecommerce traffic). I\'d much rather focus on the intricate tactics of local SEO to get a client to No. 1 on Google, Maps and Yelp.\n— Trevor Sumner, LocalVox\n4. The ability to think objectively \n\nMarketers are usually one of the most passionate workers in the office. However, that passion can often cloud the judgment and measurement of marketing theories and initiatives. A marketer who can separate themselves from their work will navigate with an objective eye that can focus on what actually works — not just what they hoped would work.\n— Wesley Mathews, High Level Marketing\n5. The ability to execute and analyze drip marketing campaigns\n\nInbound marketing is a key skill in driving lead generation. While many marketers can come up with an initial innovative engagement strategy or CPC campaign, what intrigues me more is how they examine the incoming data and create a robust drip marketing campaign. Great automation on these campaigns is not about sending the same email to the entire flock that the campaign gathers. It\'s about personal, well-written communication that varies depending on the actions performed seven emails deep into the campaign. That\'s a lot of variation, and requires an analytical mindset and strategic thinking. Exceptional marketing happens when the art of communication expands upon the fundamental science of conversion. \n— Eran Eyal, Springleap \nSEE ALSO: 11 things your startup should look for in a creative hire for 2016\n\n6. A mix of creativity and analytical abilities\n\nDigital marketing requires both creative thinking and analytical thinking, so we look for a candidate capable of and excited about both. Many new candidates want to focus purely on one or the other, but it\'s important to bring "art and science" to each digital program. Digital marketing allows us to be very measurable — even for beautiful creative campaigns — using analytics to inform future strategies. \n— Kayla Wagner Faires, Revel Interactive\n7. Good copy and visual storytelling abilities \n\nDigital media is a copy- and visual-driven medium unlike any other before it. Our social heart is won over (or double clicked on) by copy that is relevant and visuals that pull on our emotional strings. The native understanding and ability to manipulate those two elements is critical in today\'s digital marketing landscape. \n— Alex Frias, Track Marketing Group\n8. A likable personality\n\nRelationship building is such a huge component of digital marketing, and a likable personality can go a long way. With so many people trying to connect with publishers, bloggers, journalists and influencers, someone with a great personality will always stand out and command attention. If you are being pitched by two similar people and one person is the equivalent to talking to a brick wall and the other person is outgoing and pleasant, who are you going to give your time to? The same applies to maintaining relationships — having a likable personality plays such a huge role, yet it\'s often overlooked. \n— Jonathan Long, Market Domination Media\nSEE ALSO: 14 mobile marketing trends that will dominate in 2016\n\n9. An understanding of WordPress\n\nWith so many platforms now built on WordPress, it is a vital technical tool to add to your toolbox. If you want to create and manage a blog or even a website, WordPress has become the go-to platform for digital marketers. It also helps to continually educate yourself on new plug-ins and functionality because WordPress is always offering something new and useful that speeds up content production. \n— Angela Ruth, Due.com \n10. Self-promotion savvy \n\nIf you\'re telling me that you have a strong understanding of social media and leveraging brands, then it should be very easy for you to do the same with your own. My interviewees are their own first project, and I use information I can find on them to make my final decision. Something should come up when I search their names, preferably on all the same platforms that I want to use for my clients. Messaging and vis-a-vis skills should be consistent across most platforms, and some obvious care should be put into the presentation and expansion of each one.\n— Adam Steele, The Magistrate\n11. Understanding of brevity\n\nIt doesn\'t matter how good your product is if you can\'t communicate your value proposition to potential customers in fewer than 140 characters. Digital marketers must be efficient and effective with minimal messaging. \n— Nicholas Haase, Loot!\n12. The ability to analyze quantifiable metrics\n\nNow, more than ever, being able to quantify the value of investing in marketing and advertising is vital. The battle for supremacy in the marketplace is not won in whole percentage points any longer. It\'s about making the right choices and moving the needle slightly forward at every opportunity. Digital marketing consultants need to possess the competencies and the general knowledge required to provide actionable metrics, and prove their value with real data. Gone are the days of guessing whether or not a campaign was effective based on simple sales numbers. In-page tracking, coupled with analytics and metrics software are the tools of the day for marketers, and we expect any new consultants or team members to be able to leverage those tools to ensure accuracy and efficacy.\n— Blair Thomas, EMerchantBroker\nSee also: Top 11 digital advertising strategies you should use for mobile\n13. Listening skills\n\nAs a digital marketer, our ability to promote our services through words, images, video and social media are essential. Digital marketing also provides an opportunity for its specialists to listen to various groups of people, from clients to consumers, in new ways. Through social media and analytical tools, we can listen to our consumers\' thoughts on a product, relevant issue or our own services. When I hire a digital marketer, I\'ll see if they\'ve sought to listen to consumer and client needs and create a solution from their own observations or insights. \n— Shalyn Dever, Chatter Buzz\n14. Agility\n\nAt least once a month a new platform pushes its way into relevancy, or a major platform adjusts its algorithm. If you\'re/they\'re operating on a methodology devised without flexibility, and/or aren\'t the type of person to be able to react appropriately, you and your business will fall behind the curve and lose ground fast. \n— Mickey Meyer, JASH\n15. Basic design skills\n\nBeing able to communicate a message properly is extremely important. However, digital marketing involves more than just words. A large part of digital marketing is about visual appearance. Anyone who calls themselves a digital marketer should have at least some basic knowledge of HTML, CSS or Photoshop. \n— Dan Sapozhnikov, AdGate Media\nScott GerberScott Gerber is a serial entrepreneur, author (Never Get a \'Real\' Job), TV commentator and founder of Young Entrepreneur Council (YEC), an invite-only organization comprised of the world\'s most promising young entrepreneur...More\n\n\n\nTopics:\nBusiness, career advice, cover letter, digital marketing, job hunt, Jobs, Marketing, Media, resume, Social Media, Work & Play, yec\n\n\n\n\n\n\n if(window.pageChanged)\n window.omni({"channel":"business","content_type":"article","v_buy":null,"v_buy_i":null,"h_pub":603.5,"h_buy":null,"h_pub_buy":null,"v_cur":1.6,"v_max":1.6,"v_cur_i":1,"v_max_i":1,"events":"event51,event61","top_channel":"business","content_source_type":"Internal","content_source_name":"Internal","author_name":"Scott Gerber","age":"25","pub_day":8,"pub_month":3,"pub_year":2016,"pub_date":"03/08/2016","sourced_from":"Internal","isPostView":true,"post_lead_type":"Default","topics":"Business,career advice,cover letter,digital marketing,job hunt,Jobs,Marketing,Media,resume,Social Media,Uncategorized,Work & Play,yec","campaign":null,"display_mode":null,"viral_video_type":null,"b_flag":true});\n metaData = {"link":[["canonical","http://mashable.com/2016/03/08/15-skills-digital-marketers/"],["image_src","http://rack.0.mshcdn.com/media/ZgkyMDE2LzAzLzIxL2YxL0RpZ3RhbE1hcmtlLmJiZjI5LmpwZwpwCXRodW1iCTEyMDB4NjI3IwplCWpwZw/58caab29/09e/DigtalMarketing.jpg"]],"meta_property":[["og:url","http://mashable.com/2016/03/08/15-skills-digital-marketers/"],["og:title","15 essential skills all digital marketing hires must have"],["og:type","article"],["og:site_name","Mashable"],["og:description","Your prospective employer expects you to know quite a bit as a digital marketer, so we\'ve gathered 15 experts to tell you what they look for in a new hire."],["og:image","http://rack.0.mshcdn.com/media/ZgkyMDE2LzAzLzIxL2YxL0RpZ3RhbE1hcmtlLmJiZjI5LmpwZwpwCXRodW1iCTEyMDB4NjI3IwplCWpwZw/58caab29/09e/DigtalMarketing.jpg"],["og:article:published_time","2016-03-08T12:15:23Z"],["og:article:modified_time","2016-03-21T20:05:06Z"],["og:article:publisher","https://www.facebook.com/mashable"]],"meta_name":[["description","Your prospective employer expects you to know quite a bit as a digital marketer, so we\'ve gathered 15 experts to tell you what they look for in a new hire."],["keywords","social-media, job-hunt, resume, cover-letter, digital-marketing, uncategorized, yec, business, marketing, media"],["twitter:title","15 essential skills all digital marketing hires must have"],["twitter:description","Your prospective employer expects you to know quite a bit as a digital marketer, so we\'ve gathered 15 media experts to tell you what they are looking for in new hires."],["twitter:image","http://rack.2.mshcdn.com/media/ZgkyMDE2LzAzLzIxL2YxL0RpZ3RhbE1hcmtlLmJiZjI5LmpwZwpwCXRodW1iCTU2MHg3NTAKZQlqcGc/ef5be11d/09e/DigtalMarketing.jpg"],["twitter:site","@mashable"],["twitter:via","mashable"],["twitter:url","http://mashable.com/2016/03/08/15-skills-digital-marketers/"],["twitter:creator","@mashable"],["twitter:card","photo"],["twitter:image:width","560"],["twitter:image:height","750"],["date","2016-03-08 12:15:23 UTC"],["sailthru.author","Scott Gerber"],["sailthru.image.thumb","http://rack.1.mshcdn.com/media/ZgkyMDE2LzAzLzIxL2YxL0RpZ3RhbE1hcmtlLmJiZjI5LmpwZwpwCXRodW1iCTExNXgxMTUjCmUJanBn/b7eb7f95/09e/DigtalMarketing.jpg"],["sailthru.image.full","http://rack.1.mshcdn.com/media/ZgkyMDE2LzAzLzIxL2YxL0RpZ3RhbE1hcmtlLmJiZjI5LmpwZwpwCXRodW1iCTk1MHg1MzQjCmUJanBn/bb6c93c0/09e/DigtalMarketing.jpg"],["sailthru.lead_image","http://rack.3.mshcdn.com/media/ZgkyMDE2LzAzLzIxL2YxL0RpZ3RhbE1hcmtlLmJiZjI5LmpwZwpwCXRodW1iCTYwMHgzMzgjCmUJanBn/a229b3f9/09e/DigtalMarketing.jpg"],["sailthru.secondary_image","http://rack.1.mshcdn.com/media/ZgkyMDE2LzAzLzIxL2YxL0RpZ3RhbE1hcmtlLmJiZjI5LmpwZwpwCXRodW1iCTI4OHgxNjIjCmUJanBn/107c6caa/09e/DigtalMarketing.jpg"],["sailthru.exclude_homepage",false],["sailthru.exclude_uk",false],["sailthru.exclude_australia",false],["sailthru.exclude_india",false],["author","Scott Gerber"]],"short_url":[["short_url","http://on.mash.to/21hRMQD"]]};\n\n\n\n\n\n\n\n\nLoad Comments\n\n\n\n\n\n\n\nWhat\'s Hot\n\n\n\n\n\nMore in Business\n\n\n\n\n\nWhat\'s New\n\n\nWhat\'s Rising\n\n\nWhat\'s Hot\n\n\n\n\n\nWhat\'s New\nWhat\'s Rising\nWhat\'s Hot\n\n\n\n\n (function(){\n loadScriptAsync("//platform.twitter.com/oct.js", "twitteroct")\n var timer;\n timer = every(500, function() {\n if ((typeof twttr !== "undefined" && twttr !== null) && (twttr.conversion != null)) {\n clearInterval(timer);\n return twttr.conversion.trackPid(\'l4o6d\');\n }\n });\n }());\n\n\n\n\n\n\n\n\n if(window.initPage) { window.initPage() }\n else { $(function() { window.initPage(); })}\n\n\nAbout UsJobsAdvertiseSubscribePrivacyTerms\n\n\n\n\n\n\n\n\n\nMashable\n\nis a global, multi-platform media and entertainment company. Powered by its own proprietary technology, Mashable is the go-to source for tech, digital culture and entertainment content for its dedicated and influential audience around the globe.\n\n\n\n©2005-2016\nMashable, Inc.\n\n\nReproduction without explicit permission is prohibited. All Rights Reserved.\n\n\nDesigned in collaboration with Code & Theory\n\n\n\n\n\n\n\n\n\n window.detectStaffEditableLink();\n\n\n\n', 'title': '15 essential skills all digital marketing hires must have'}
url_ = 'http://mashable.com/2016/03/31/donald-trump-gaslighting-women'
news_info(url_)
{'author': 'Rebecca Ruiz', 'author_networks': {'facebo': '', 'google': '', 'linked': '', 'twitte': 'https://twitter.com/rebecca_ruiz', 'twitter_followers': 3736}, 'author_web': 'http://mashable.com/people/rebecca-ruiz/', 'shares': '1900', 'text': 'Analysis\n\n\n\n\n\nThere is a reason that\xa0Donald Trump\'s\xa0outrageous statements and behavior feel familiar to many women.\xa0\nIt\'s not because they know his declarative style and trademark shrug from reality television or political debates. Nor is it because his outsized role in American business made an unforgettable impression on them.\nSEE ALSO: As Donald Trump targets women, Republicans say he could cost the party everything\nThe eerie familiarity is more personal than that. They know Trump because they\'ve encountered a man like him at home, work, on social media or in a relationship.\xa0\nThis man extols the virtues of women, but has no problem reducing them to sex objects. He casts himself as unflappable, but blames a woman when his weaknesses are revealed. He insists on personal responsibility, but denies, deflects and perhaps even turns violent when accused of wrongdoing.\xa0\n\nThe media is so after me on women Wow, this is a tough business. Nobody has more respect for women than Donald Trump!\n— Donald J. Trump (@realDonaldTrump) March 26, 2016\n\nThe psychological warfare of gaslighting, a subtle form of emotional abuse that puts the victim on the defensive, is his go-to strategy.\xa0\xa0\xa0\xa0\nThis is not how Trump sees himself or his actions, but it is arguably the image he projects to voters.\xa0On Tuesday, when Florida police charged his campaign manager, Corey Lewandowski, with battery of a female reporter, Trump issued a series of tweets refuting the video evidence, discrediting the journalist and implying she could have been a dangerous or deadly threat.\xa0\n\nWow, Corey Lewandowski, my campaign manager and a very decent man, was just charged with assaulting a reporter. Look at tapes-nothing there!\n— Donald J. Trump (@realDonaldTrump) March 29, 2016\n\nPowerful women on the left and right forcefully criticized Trump\'s reaction to the charges. \n“Too often victims of violence and abuse stay silent, and Donald Trump’s remarks today demonstrate one of the reasons why," Dawn Laguens, executive vice president of the Planned Parenthood Action Fund, said in a statement. "His actions today underscore that it is a fiction that he has been or would be supportive of any woman in this country."\n\nThis was the reporters statement- when she found out there was tape from my facility, she changed her tune. pic.twitter.com/N5815RS1At\n— Donald J. Trump (@realDonaldTrump) March 29, 2016\n\n\nWhy is this reporter touching me as I leave news conference? What is in her hand?? pic.twitter.com/HQB8dl0fhn\n— Donald J. Trump (@realDonaldTrump) March 29, 2016\n\nOn Wednesday, a group of conservative female journalists and commentators called for Lewandowski\'s firing.\nTrump has a track record of making his female targets — and their defenders — seem like the foolish ones.\n\nNichole Bauer, assistant professor in the political science department at the University of Alabama, says the response was classic Trump. He\'s practiced at denying previous statements even when\xa0incontrovertible\xa0evidence of them exists. While this isn\'t exclusive to his commentary about women, Trump has a track record of making his female targets — and their defenders — seem like the foolish ones.\xa0\nOf course he wasn\'t making a reference to menstruation when he joked about\xa0Fox anchor Megyn Kelly having "blood coming out of her wherever" during a debate. And no, he most certainly did not use schlonged as a vulgar term when describing how badly Pres. Barack Obama beat Hillary Clinton in the 2008 Democratic presidential primary.\xa0\n\nThe press is going out of their way to convince people that I do not like or respect women, when they know that it is just the opposite!\n— Donald J. Trump (@realDonaldTrump) March 26, 2016\n\n"There’s definitely an accepted belief among the Republican and Democratic mainstream that this sort of outmoded sexism that Donald Trump demonstrates has no real place in discourse," says Bauer.\xa0\nYet, instead of apologizing, or acknowledging how the woman in question — or any woman, for that matter — might find his remarks offensive, Trump doubled down and obfuscated reality.\xa0\nMany women have been here before, whether it\'s with a coworker who denies the meaning of a sexist comment or a partner who is quick to end an argument by using the word emotional.\xa0\n...he\'s telling women that they don\'t deserve the same respect and agency as men.\nTrump\'s denials may make him appear unassailable to some, but to women they send an entirely different message, says Bauer. By denying the nature of his commentary and behavior, he\'s telling women that they don\'t deserve the same respect and agency as men.\xa0\nWhile Republican women tend to support traditional roles, Bauer says, they do so believing that deference to a male authority figure or husband is their choice. Trump\'s faultless behavior effectively takes that autonomy away from them by creating a political climate in which the woman is always wrong.\xa0\nThis may\xa0explain why he performed so poorly with Republican women in one recent survey. That\xa0NBC/WSJ poll found that 47% of female Republican primary voters cannot see themselves voting for Trump. His favorability ratings were higher, at 59%, amongst registered Republican women in a\xa0CNN/ORC poll, though it did not ask whether they intended to vote for him.\n\n"@Don_Vito_08: "A picture is worth a thousand words" @realDonaldTrump #LyingTed #NeverCruz @MELANIATRUMP pic.twitter.com/5bvVEwMVF8"\n— Donald J. Trump (@realDonaldTrump) March 24, 2016\n\nThese polls also don\'t fully reflect his\xa0recent, unseemly attacks on Heidi Cruz, wife of his opponent Sen. Ted Cruz, or his statement on Wednesday that if abortion is banned, women who have one illegally should "face some sort of punishment."\xa0\nThough Trump immediately clarified that comment as a response to a hypothetical question and then reversed his position, it\'s clear that he\'s not only willing to publicly embarrass and degrade women, but also consider\xa0depriving them of physical\xa0freedom.\xa0\nSuch power dynamics aren\'t hypothetical to women in abusive workplaces or relationships, who cannot fathom a political reality that mirrors their private hell.\xa0\n"People are doing it as a strategy to control others and elevate themselves and insulate themselves from attack."\nJackie White, emerita professor of psychology and a senior research scientist at the Center for Women’s Health and Wellness at the University of North Carolina at Greensboro, says an approach that victimizes women and then blames them for playing a part in their degradation is about manipulation.\xa0\n"People are doing it as a strategy to control others and elevate themselves and insulate themselves from attack," she says. "They’re going to present themselves as a very self-assured, knowledgable person."\xa0\nMeanwhile, such behavior silences the victim. She may feel depressed, passive or paralyzed. Feelings of doubt and insecurity set in. Women know this experience well, says White.\xa0\nShe worries, however, that the tactics on display in the\xa0campaign could send just as powerful a message to men as to women.\xa0\nTrump\'s behavior may consciously or\xa0subconsciously\xa0lead some men to\xa0endorse harmful stereotypes and engage in emotional manipulation, particularly if they feel threatened by social and demographic change and evolving gender roles.\n"[Trump\'s] actions could inspire them to feel justified in clinging to what they see as their deserved elevated status," White says.\xa0\nThat\'s what makes Donald Trump so dangerous. Even if he\'s offering the public a performance, the fallout is unconscionable for both women and men.\xa0\n', 'title': 'Every woman has met a man like Donald Trump'}