Quirin
Forum Replies Created
-
AuthorPosts
-
September 7, 2018 at 10:44 am #1266QuirinParticipant
Thanks for your answer! I’d like to stick with my single Gmail account for several reasons, so I guess I’ll have to switch back from 15 to 60 min intervals for the
getTweets
trigger. My only concern for that is that I’d get less than the maximum number of tweets that could be harvested for my queries, as the absolute frequency of tweets for those queries are crucial for my research project. Would I get a warning or error if I hit that ceiling?July 27, 2018 at 3:14 pm #1240QuirinParticipantSorry, but one more question about rate limiting.
First of all: is the total limit 18,000 (what I thought) or 180,000 as implied above?
I’m currently using about 30 sheets in parallel, and I’m trying to figure out to set up the maximum number of tweets, so that I won’t exceed the rate limit for any of the queries. Would it make sense to set the limit for each individual sheet to 18,000 / 30 so that the maximum cannot be reached? Ideally, I’d want to set it up in a way so that I get no ceiling effects at all.
And if I want to even increase the number of parallel queries I would probably have to switch to a different setup involving the Streaming API, right?
Best,
QuirinJuly 2, 2018 at 10:47 am #1215QuirinParticipantHi Martin,
Thanks for your suggestion!
I haven’t tried it because I’ve used a simple workaround:
* I download all the files as
.xlsx
which works fine because one can select multiple files for download from Google Drive.
* I batch-convert them usingssconvert
to.csv
on the Command LineBest,
QuirinNovember 18, 2017 at 9:21 pm #1088QuirinParticipantThanks for offering this workaround! I’m still hoping for the option that new sheets will be created automatically, but thanks anyway! 🙂
October 31, 2017 at 12:03 pm #1072QuirinParticipantHi Matthew,
Is it possible to set up an alert for sheets that automatically sends me an email (or something similar) when a sheet reaches a threshhold of e.g. 30,000 lines? Then I wouldn’t need to check all sheets all the time. That would be a makeshift solution for the problem mentioned above which I’m still facing.
Best,
QuirinSeptember 7, 2017 at 8:31 am #1028QuirinParticipantGreat, thanks, looking forward to it! 🙂
June 6, 2017 at 10:33 am #971QuirinParticipantAlright, I see, thanks again for your quick help!
June 5, 2017 at 1:28 pm #969QuirinParticipantThanks for your quick reply!
I checked again and you’re right: The first 991 rows are empty, but there is data below that. Sorry, I didn’t scroll down long enough before. Thanks a million!
Follow-up question: Is there a clever way of avoiding the size limit in the future? It’s not possible to split or automatically create new sheets once the current one is full, right? This would be a brilliant feature! And I think I read somewhere that about 30,000 rows per sheet are the maximum, is that correct? Then I guess I’ll try to keep track and manually split sheets when they are close to that number.
And then one last thing: You don’t happen to know why the .ods export doesn’t work, do you? Opening the .xlsx with Libre Office is a reasonable workaround though, so it’s not a big deal.
Thanks again!
QuirinJune 5, 2017 at 11:10 am #967QuirinParticipantUpdate: I managed to open the .xlsx file with LibreOffice. Unfortunately, the ‘Archive’ sheet is empty there too, though. The file is about 18 MB, so I guess the archive data should be somewhere in the file though, right?
-
AuthorPosts