Conversation

JSON Baumgartner

@jasonbaumgartne

·

May 23, 2018

I am creating a project board and eventually a wiki for the Google #bigquery / Pushshift integration. However, #reddit comments are now streaming live into BQ! Could someone please confirm that they can access the dataset?

github.com

GitHub - pushshift/google_bigquery

Contribute to pushshift/google_bigquery development by creating an account on GitHub.

2

1

1

JSON Baumgartner

@jasonbaumgartne

·

May 23, 2018

You will need to switch from legacy SQL on the Google BQ dashboard. Just try to do a simple select: SELECT * FROM `pushshift.rt_reddit.comments` LIMIT 10 The dashboard should be located here: https://bigquery.cloud.google.com

1

flashman

@flashman

·

May 23, 2018

Replying to

@jasonbaumgartne

"Query complete (3.4s elapsed, 0 B processed)" looks good

1

1

JSON Baumgartner

@jasonbaumgartne

Replying to

@flashman

Awesome! You're able to access it. Thanks so much!!!

1:45 AM · May 23, 2018·Twitter Web Client

flashman

@flashman

·

May 23, 2018

Replying to

@jasonbaumgartne

New ones coming in, too, judging by "order by desc on created_utc"

1

JSON Baumgartner

@jasonbaumgartne

·

May 23, 2018

Replying to

@flashman

That's great news. The feed should be very close to real-time (a 1-3 second delay at most usually).

1

Show replies