Gnip’s Decahose 2.0 now available in beta

By Adam Tornes
Wednesday, 6 April 2016

We’re excited to announce the public beta for Gnip’s Decahose 2.0, which delivers a 10% random sample of the real-time firehose of Twitter data. A few months back, we announced Gnip 2.0, a step change in our real-time and historical products that introduces enhanced versions of our core API products using rich new data available in Twitter systems. We’re phasing the migration to Gnip 2.0 products over the course of 2016 and have already launched PowerTrack 2.0 and 30-Day Search 2.0 in public beta.

The beta for Decahose 2.0 offers several new features:

  • Enhanced URL enrichment: The URL expansion enrichment now includes page titles and descriptions to help you better identify content that’s relevant to your analysis.
  • New partitioning support: With stream partitioning, you can ingest the Decahose in a more predictable and efficient way by dividing large volumes of data into smaller and more manageable segments. Decahose 2.0 will have two partitions, each containing 50% of the volume of the Decahose.
  • Even better reliability: We’ve increased the geographic diversity of the systems serving you data to give you even greater confidence you will get every Tweet you need.

We’re targeting a GA release in the near future and need your feedback to get there. As a beta customer, not only will you get first access to these new features, you’ll also have the opportunity to share feedback on how Decahose 2.0 performs in your environment. To join the beta, contact your account manager or email data-sales@twitter.com.