Apple published an interesting visualization of data they have on the number of times Apple Maps users looked up directions and how the frequency has changed during the pandemic.
The Mobility Trends Report is not only a great way to show the value of Apple’s aggregate data but also an opportunity for the company to explain it’s privacy policies.
Privacy is a fundamental human right. At Apple, it’s also one of our core values, so Maps doesn’t associate your data with your Apple ID, and Apple doesn’t keep a history of where you’ve been.
This data is generated by counting the number of requests made to Apple Maps for directions in select countries/regions, sub-regions, and cities. Data that is sent from users’ devices to the Maps service is associated with random, rotating identifiers so Apple doesn’t have a profile of your movements and searches. The availability of data in a particular country/region, sub-region, or city is based on a number of factors, including minimum thresholds for direction requests per day.
When you work for a news app and there’s lots of news, you’re busy.
At SmartNews we’ve been busy trying to get a handle on the numbers behind the Coronavirus pandemic and present it in a way that is meaningful to SmartNews users.
We started with a simple widget with totals for confirmed cases along with those that had recovered. We designed a way to put US and Global numbers in once widget that updated daily. Tapping on the More data link to you to a full page with interactive graphs showing the cumulative totals of these numbers over time along with the death count.
As casualties grew and recovery data started to look inconsistent (it’s not clear when you recover and many states do not require hospitals to record recovery rates), we made the difficult decision to post the death count on the widget, replacing the recovered figure. We re-built the data pipeline to pull in data more frequently so we added a counter to show the current daily totals compared to yesterday’s total.
Then we added county-level data to satisfy the growing interest in local information.
The most recent iteration, in the app today, adds back in the global number to give context to the US figures. We’ll continue to iterate on this widget to bring the most useful information to our users.
In case you missed it, SmartNews had a big round of funding last year which we are using to staff up positions here in the United States. While we’ve always had openings for machine learning engineers (doesn’t everyone?) we now are also staffing up in Product, Marketing, and Biz Dev.
If you’re interested in learning more about any of these roles, let me know!
This did not occur to me. As an algorithm gets better at recommending content that matches and reinforces what a community is looking for, the negative complaints go down which makes it harder for someone outside (such as platform moderators) the filter bubble from detecting these closed communities in the first place.
The algorithm is doing what it was designed to do but without any moral compass, its overall contribution to society is questionable.
Here’s someone who worked on the YouTube algorithm commenting on this (emphasis mine).
Using recommendation algorithms, YouTube’s AI is designed to increase the time that people spend online. Those algorithms track and measure the previous viewing habits of the user—and users like them—to find and recommend other videos that they will engage with.
In the case of the pedophile scandal, YouTube’s AI was actively recommending suggestive videos of children to users who were most likely to engage with those videos. The stronger the AI becomes—that is, the more data it has—the more efficient it will become at recommending specific user-targeted content.
Here’s where it gets dangerous: As the AI improves, it will be able to more precisely predict who is interested in this content; thus, it’s also less likely to recommend such content to those who aren’t. At that stage, problems with the algorithm become exponentially harder to notice, as content is unlikely to be flagged or reported. In the case of the pedophilia recommendation chain, YouTube should be grateful to the user who found and exposed it. Without him, the cycle could have continued for years.
This is a shameless pitch for a plugin to WordPress my company just published but there are also broader ideas proposed here and I would love your feedback.
SmartNews is a mobile news aggregation app. The backend tech is pretty nifty. It uses machine learning and what we call a “discovery algorithm” to expose users to new points of view that they might not see if they are using a social network or personalized news service to read their news. You can read more about that stuff here, that’s not what this blog post is about.
SmartNews aggregates news from our partners. If we have no news, we have nothing for our users to read. While it’s possible to crawl the web and pull in stories as we find them on the open web, we would prefer a relationship with each of our publishing partners so they send us their articles and feel in control of how their content is used by SmartNews. We want our partners to feel as if the SmartNews app is an extension of their CMS. If our partners are not successful, neither will SmartNews.
While we do send traffic to our publishers (lots of it) that’s not the only benefit we offer. We have architected the product to offer a snappier, native view (think of Safari or Chrome’s reader mode) of the articles. Because this view is hosted on our app, our users can read while offline. The SmartView page in SmartNews was designed to serve the subway commuter in Tokyo where signals were spotty.
But we wanted to make sure publishers had a benefit when readers chose to read their articles via the SmartView page. Thus the SmartFormat feed spec was born. SmartFormat is a simple variant of the RSS standard with a couple new elements to provide greater portability of not only a publisher’s articles but also their advertising and analytics.
The <snf:advertisement> element lets publishers provide an ad tag which we run on the SmartView page. Because this is the publisher’s ad tag, the publisher keeps 100% of the revenue.
The <snf:analytics> element lets the publisher send along the analytics bug so they can include SmartView pageviews in the total pageviews that they see on their dashboard.
Combined, both the <snf:advertisment> and <snf:analytics> allow for portability of not only content but also advertising. Now when a publisher distributes a full text feed to SmartNews they also are distributing the monetization and analtyics footprint as well. While other platforms require you to opt in to revenue shares on the platform’s advertising and analytics, SmartNews lets you use and optimize your own, dynamically, on a feed endpoint you control.
Now to the fun part. If you’re running on WordPress, we have a simple plugin that will open up two text boxes, one for and one for and will build a SmartFormat feed compliant with the SmartFormat feed spec. In order to get distribution on SmartNews, all you have to do is apply to be a publisher on SmartNews, install the plug-in, then you’re ready to go!
As for the broader proposal, I was curious (and I could very well be looking in the wrong places) why no one has attempted to extend RSS in this way before? Feedburner had something where they injected Google Ads into their RSS feeds but it never really took off because those ads only ran in the feed or feedreader, not on the downstream aggregation sites or platforms. As much as I am loath to try and extend a standard, wouldn’t it benefit publishers to have a place where they can add their ad tag, analytics scripts, and even subscription CTAs so that the business travels along with the editorial?
<snf:advertisement> and <snf:analytics> work great for SmartNews but what about extending it for others? The more platforms that accept this extended feed, the more incentive there is for publishers to create these feeds. Seems like the classic win-win all around. Besides the bureaucratic lift of trying to extend a “standard” such as RSS am I missing something?
April Fool’s Day is always a busy day at SmartNews as our news discovery algorithm get overly excited with all the cool, interesting and unique news released that day. Here’s a running log of what we’ve had to gently remind the algorithm is actually just a joke.
After watching the HBO documentary about Elizabeth Holmes and Theranos, I’m all in everything about how she pulled the wool over so many eyes and got so many people (mostly older men points out my wife) to hand over their wallets. It’s a cautionary tale for the fast & loose culture of Silicon Valley that is starting to bump up against more traditional and heavily regulated industries such as medicine, banking, and transportation. Think of CRISPR, cryptocurrency, Space-X and Tesla as examples of projects that need to take extra care as they innovate so as not to lose the public’s trust.
Here’s my reading list:
Bad Blood – by John Carreyrou – the book by the guy that broke the story
It’s been twelve years since I last was at SXSW – time flies – I wroteaboutitthen so for continuity’s sake I might as well share some highlights from this year.
What I learned
Following the success of the New York Times’ The Daily podcast, the Grey Lady will dip its toe into broadcast TV with a weekly show called, you guessed it, The Weekly. Following the same formula, The Weekly will go deep on one story and, in 30 minutes, bring viewers the broader picture of how a news article comes together and convey things via video that cannot be expressed in print. The Weekly will air sometime in June on FX.
I saw Senator Amy Klobuchar expertly deflect a pointed question about her comb/salad incident, brushing it off as, a mom thing and moving on to a broader point about expecting the best from herself and her staff.
I saw the intersection of two writing cultures in the The New Yorker but Make it Internet panel. I learned that while you “post” something online, you “close” it in print. The young writers who post regularly online shared their experiencing getting edited for longer pieces in print where they still use words such as “teen-ager” and “web site” is written with two words.
Lots of talk about Artificial Intelligence and how it will impact journalism and storytelling (film). Sony demonstrated software that can write music. Many media outlets admitted to deploying AI to write summaries of high school sports or financial earnings reports and some are using AI to look for anomalies in large datasets for primary investigation. Several funny stories shared of flat-footed AI recommendation systems, “You’re here for the parenting, stay for Iraq!” and how one-dimensional AI can be (intense interest in how to raise a baby does not evolve into how to raise a child).
This reminds me of what Kathy Sierra said about apps in 2007 at my first SXSW,
All apps have a Asperger’s Syndrome. They cannot pick up on visual queues from their users such as when someone is angry, frustrated, or confused. If a user has these reactions to software, they quickly fall below the suck threshold.
Kathy Sierra, SXSW Keynote, 2007
We must always remember that any Artificial Intelligence was born in the mind of someone, somewhere and has the biases of that person or team of people baked right into it and remains static, not taking in the inexplicit contexts of its environment,
What I experienced
SXSW is much bigger than it was 12 years ago. While I was last in Austin for the annual Online News Association meeting which took over the JW Marriott, SXSW sprawled over not only the JW Marriott but also the Austin Convention Center and Fairmont Hotels with pavilion and bar takeovers all across town. I don’t think Rainy Street was a thing back in 2007. It is not only the Interactive festival but also gathering for music and new film releases which I was somehow oblivious of the last time. I thought I could plan ahead and pick and chose what I wanted to see but soon realized that would be an exercise in frustration and that it was better to just have a rough idea of a few things you wanted to seek out and then let the winds of chance take you from one thing to the next.
I wandered into the Japan pavilion where the Japanese comedian, Yuriyan Retriever (ゆりやんレトリィバァ) narrated a guy who was creating a stop-motion video on his iPad in front of the most-patient audience I had ever seen. I’ve written about her before, she’s got a great bit on the Oscar’s acceptance speech.
SXSW with your son
Tyler had the week off from college so I suggested he come down from Boston to Austin and take advantage of the hotel room and get to know the city and take in the festival. Unfortunately he came down with a nasty cold for the first two days but we did get a chance to walk (and scooter) around a bit on Monday and Tuesday. I loved just walking around and experiencing things through his eyes.
While Twitter and Foursquare famously launched at SXSW – this year was the coming out party for electric scooters. The grab-and-go rentals were everywhere with competing pods from Uber/Jump, Lyft, Bird, Lime, and others. In my unofficial survey, the late-model Lyft scooters had the most “umph” to them.
The Interactive badge got me into all the media sessions that I wanted to attend and they had this new SXXPress system that, like a Disneyland FastPass, let you jump the line and grab a guaranteed seat. Also discovered a hack to get into the more popular talks was to attend the talk in the time slot prior and squat in a seat and make small talk with your neighbors. This hack probably won’t work next year as many were catching on to this as the festival went on.
Be sure to check out a film or band in the evenings. While the Interactive lanyard will not give you first dibs or get you into the big name premiers, it will get you in for free if space is available. I caught the premier of the excellent documentary, Mr. Jimmy and the Welsh band Novo Amor.
I booked my hotel very late but was able to score a room at the Marriott Residence Inn at The Domain which has a Costco-sized Whole Foods which is a wonder to behold. The Domain is way out of town and costs $20+ in a Lyft but discovered a tram station 10-minute’s walk away that only costs $3 and takes you right into town, next to the Convention Center. Riding the tram I learned:
West Austin is where rich housewives gather for yoga sessions an Kombucha exchange parties,
People in Austin get discounted passes to SXSW, many also volunteer which gives them access to events when they’re not working,
The Domain is a soulless retail development and signaled to many locals the end of Austin
Yeah the BBQ is awesome. Iron Works, Coopers and all the other places – there are tons of places to eat. If you’re looking for something else, Gus’s Chicken (it’s world famous ya know) is good for lunch and the Texas Chili Parlor is a must do when finishing out a night on the town.
Kevin Kelly is the master of optimistic projection. Drawing a line Just as VR and AR start their decent into the trough of disillusionment, Kevin Kelly and Wired comes out with a cover story that looks beyond the immediate applications and imagines the opportunities in the great beyond.
The first big technology platform was the web, which digitized information, subjecting knowledge to the power of algorithms; it came to be dominated by Google. The second great platform was social media, running primarily on mobile phones. It digitized people and subjected human behavior and relationships to the power of algorithms, and it is ruled by Facebook and WeChat.
We are now at the dawn of the third platform, which will digitize the rest of the world. On this platform, all things and places will be machine-readable, subject to the power of algorithms. Whoever dominates this grand third platform will become among the wealthiest and most powerful people and companies in history, just as those who now dominate the first two platforms have. Also, like its predecessors, this new platform will unleash the prosperity of thousands more companies in its ecosystem, and a million new ideas—and problems—that weren’t possible before machines could read the world.
Information – People – Places & Objects. Who is going to figure out search on the mirrorworld? The social graph was the innovation that organized the social web. What will be the innovation to organize the world of places and objects? Voice UI?