Hi. I have a problem with certain tweets that have embedded tweets. Generally these tweets have a “media_url” entry in the entities string, but in tweets that I have collected this component does not exist in the entity string despite the tweet having a picture. I have noticed that in such cases, the raw text of the tweet has been truncated or is filled with gibberish characters (&*&#(!).
Do these 2 observations have any relation to one another? Is one the cause and the other an effect? Is there a way to resolve both observations so that the data collected remains pure and complete?
Thank you.