Twarc

Latest version: v2.14.0

Safety actively analyzes 638418 Python packages for vulnerabilities to keep your Python projects secure.

Scan your dependencies

Page 7 of 22

2.3.8

This bugfix release reuses twarc.decorators2.catch_request_exceptions in the
context of streaming responses (twarc2 sample and twarc2 stream) that use the `response.iter_lines` method. Hopefully this will address 505 but it will require testing by people who continue seeing
the error in the wild.

2.3.7

v2.3.7 includes new functionality that adds progress bars for twarc2 commands like search, hydrate, timeline and more. These visual indications of how much data has been collected and how much there is to go are extremely useful in data collection jobs. Progress bars display by default when you instruct twarc to write output to a file (490).

![twarc-progressbar](https://user-images.githubusercontent.com/33829/124528558-77591a00-ddd6-11eb-989b-09b4e413cfef.gif)

Additionally there is new code to catch 503 Twitter API errors that have recently been occurring much more regularly (499). Apparently a big reason for these errors was the load that requesting 500 tweets from the search/all endpoint while also asking for context annotations. Twitter recently announced they were no longer making context annotations available for requests asking for more than 100 tweets. Since it's one of twarc's design principles to maximize the representation of tweets the search command has been adjusted to default to 100 now instead of 500, at least for the time being (504).

2.3.6

A bugfix release for Twarc2.stream so that it reconnects after being instructed to disconnect, and then continues to fetch data from the stream.

2.3.5

Disable running stream unit test under GitHub Actions since it returns a 400 error.

2.3.4

More code to handle ChunkedEncodingError in stream as well as sample. Logging was updated to include tweet ids that have been collected.

2.3.3

This release adds functionality to twarc.Twarc2 to catch any requests exception when reading from recent or all stream. See 471 for background.

Page 7 of 22

© 2024 Safety CLI Cybersecurity Inc. All Rights Reserved.