[Quirin]

Thanks for your answer! I’d like to stick with my single Gmail account for several reasons, so I guess I’ll have to switch back from 15 to 60 min intervals for the getTweets trigger. My only concern for that is that I’d get less than the maximum number of tweets that could be harvested for my queries, as the absolute frequency of tweets for those queries are crucial for my research project. Would I get a warning or error if I hit that ceiling?

[Quirin]

Sorry, but one more question about rate limiting.

First of all: is the total limit 18,000 (what I thought) or 180,000 as implied above?

I’m currently using about 30 sheets in parallel, and I’m trying to figure out to set up the maximum number of tweets, so that I won’t exceed the rate limit for any of the queries. Would it make sense to set the limit for each individual sheet to 18,000 / 30 so that the maximum cannot be reached? Ideally, I’d want to set it up in a way so that I get no ceiling effects at all.

And if I want to even increase the number of parallel queries I would probably have to switch to a different setup involving the Streaming API, right?

Best,
Quirin

[Quirin]

Hi Martin,

Thanks for your suggestion!

I haven’t tried it because I’ve used a simple workaround:

* I download all the files as .xlsx which works fine because one can select multiple files for download from Google Drive.
* I batch-convert them using ssconvert to .csv on the Command Line

Best,
Quirin

[Quirin]

Thanks for offering this workaround! I’m still hoping for the option that new sheets will be created automatically, but thanks anyway! 🙂

[Quirin]

Hi Matthew,

Is it possible to set up an alert for sheets that automatically sends me an email (or something similar) when a sheet reaches a threshhold of e.g. 30,000 lines? Then I wouldn’t need to check all sheets all the time. That would be a makeshift solution for the problem mentioned above which I’m still facing.

Best,
Quirin

[Quirin]

Great, thanks, looking forward to it! 🙂

[Quirin]

Alright, I see, thanks again for your quick help!

[Quirin]

Thanks for your quick reply!

I checked again and you’re right: The first 991 rows are empty, but there is data below that. Sorry, I didn’t scroll down long enough before. Thanks a million!

Follow-up question: Is there a clever way of avoiding the size limit in the future? It’s not possible to split or automatically create new sheets once the current one is full, right? This would be a brilliant feature! And I think I read somewhere that about 30,000 rows per sheet are the maximum, is that correct? Then I guess I’ll try to keep track and manually split sheets when they are close to that number.

And then one last thing: You don’t happen to know why the .ods export doesn’t work, do you? Opening the .xlsx with Libre Office is a reasonable workaround though, so it’s not a big deal.

Thanks again!
Quirin

[Quirin]

Update: I managed to open the .xlsx file with LibreOffice. Unfortunately, the ‘Archive’ sheet is empty there too, though. The file is about 18 MB, so I guess the archive data should be somewhere in the file though, right?

[Author]

Posts