Behind the effort to archive Nintendo’s disappearing social network – Ars Technica

On November 7, another piece of Nintendo’s short online history will go away forever. That’s when Miiverse, the artwork and message sharing service embedded into many Wii U games, will be shutting down because, as Nintendo puts it, “among other reasons, many users are shifting to social networking services.” While users can request an archive of their own Miiverse posts and drawings, the millions of memes, bad jokes, incisive game criticism, and more currently hosted on Miiverse will be removed from Nintendo’s public servers in a few months (some features of certain Wii U games will also be impacted, as detailed in this FAQ).

That massive purge of player-created data wasn’t acceptable to professional Web developer Tim Miller. Shortly after Nintendo announced the Miiverse shutdown last week, Miller started up an effort to permanently archive the network’s public contents, complete with a GitHub page and the support of the Web preservationists at Archive Team.

“Any time a social network goes down, we lose a ton of data,” Miller told Ars in an IRC chat. “Part of history, our culture, is lost. In Miiverse, especially in the art section, you can see people really investing a lot of their time and energy in it. And being able to save that for others to see and experience is extremely important.

“Just look at the people still making Splatoon art, right now, even though it’s going away in a few months,” he continued. “It’s clear some people out there care about it, and preserving this data would be [a] great thing for all. It’s important to remember that, when you give your data to companies like this, they can just as easily throw it away. And with that, so goes years of history.”

While Miller says he understands why Nintendo is shutting down Miiverse in the face of other, broader social networks, he’s not happy with the way the company is handling all the user-created data it has accumulated in the last few years. “Right now, Nintendo is going ‘Remember to click this button, and we’ll give you a zip at some point, now it’s your problem,'” he told Ars. “To me, that’s a giant ‘fuck you.’ At least it’s better than other companies that just close up shop and don’t announce it, but they could do better.”

The scrape race

Wonderful dot-art like this is part of what the Miiverse preservation effort is trying to save.

The Miiverse archiving effort is still in its early days. Because Miiverse has no public API, the team is still figuring out how to parse Miiverse URLs to get at all the network’s public data through HTML scraping. Once that’s done, Miller and other volunteers will set up VM scripts that can crowdsource the downloading and processing effort through Archive Team’s Warrior tool.

So far, the team has identified more than 2 million distinct Miiverse users by following the trail of friends lists. While some of those users hide part of their profiles behind privacy settings, the vast majority of the posts themselves are public, Miller says.

It’ll be a bit of a race to scrape the millions of published Miiverse posts and drawings from all those users before the November 7 shutdown, but Miller is confident that it’s possible with Archive Team’s resources. After that, Miller says he wants to organize it all into a database and maybe build a public website so people can search through the Miiverse archive at their leisure.

Those that forget history…


Write a Reply or Comment:

You must be logged in to post a comment.

This site uses Akismet to reduce spam. Learn how your comment data is processed.