Streamparse

Latest version: v5.0.1

Safety actively analyzes 688554 Python packages for vulnerabilities to keep your Python projects secure.

Scan your dependencies

Page 4 of 8

3.6.0

This has bunch of bugfixes, but a few new features too.

Features
- Added `virtualenv_name` as a setting in `config.json` for users who want to reuse the same virtualenv for multiple topologies. (Issue 371, PR 373)
- Support `ruamel.yaml>=0.15` (PR 379)
- You can now inherit Storm Thrift types directly from `streamparse.thrift` instead of needing the extra `from streamparse.thrift import storm_thrift` (PR 380)
- Added `--timeout` option to `sparse run`, `sparse list`, and `sparse submit` so that you can control how long to wait for Nimbus to respond before timing out. This is very useful on slow connections. (Issue 341, PR 381)

Fixes
- Fixed failing `fabfile.py` and `tasks.py` imports in `get_user_tasks` with Python 3. (Issue 376, PR 378)
- Made Storm version parsing a little more lenient to fix some rare crashes (Issue 356)
- Added documentation on how to pass string arguments to Java constructors (Issue 357)
- Added documentation on how to create topologies with cycles in them (Issue 339)
- Fixed issue where we were writing invalid YAML when a string contained a colon. (Issue 361)
- We now pass on the serialized properly with `sparse run` (Issue 340, PR 382)
- `sparse` no longer crashes on Windows (Issues 346 and pystorm/pystorm40, PR pystorm/pystorm45)

3.5.0

This release brings some compatibility fixes for Storm 1.0.3+.

Features
- Propagate topology parallelism settings to Flux when using `sparse run` (Issue 364, PR 365)
- Pass component configs on to Flux when using `sparse run` (PR 266)

Fixes
- Make sure output shows up when using `sparse run` (PR 363)
- Handle new `resources` nesting added in Storm 1.0.3 (Issue 362, PR 366)

3.4.0

This release fixes a few bugs and adds a few new features that require pystorm 3.1.0 or greater.

Features
- Added a `ReliableSpout` implementation that can be used to have spouts that will automatically replay failed tuples up to a specified number of times before giving up on them. (pystorm/pystorm39)
- Added `Spout.activate` and `Spout.deactivate` methods that will be called in Storm 1.1.0 and above when a spout is activated or deactivated. This is handy if you want to close database connections on deactivation and reconnect on activation. (Issue 351, PR pystorm/pystorm42)
- Can now override `config.json` Nimbus host and port with the `STREAMPARSE_NIMBUS` environment variable (PR 347)
- Original topology name will now be sent to Storm as `topology.original_name` even when you're using `sparse --override_name`. (PR 354)

Fixes
- Fixed an issue where batching bolts would fail all batches they had received when they encountered an exception, even when `exit_on_exception` was `False`. Now they will only fail the current batch when `exit_on_exception` is `False`; if it is `True`, all batches are still failed. (PR pystorm/pystorm43)
- No longer call `lein jar` twice when creating jars. (PR 348)
- We now use `yaml.safe_load` instead of `yaml.load` when parsing command line options. (commit 6e8c4d8)

3.3.0

This release fixes a few bugs and adds the ability to pre-build JARs for submission to Storm/Nimbus..

Features
- Added `--local_jar_path` and `--remote_jar_path` options to `submit` to allow the re-use of pre-built JARs. This should make deploying topologies that are all within the same Python project much faster. (Issue 332)
- Added `help` subcommand, since it's not immediately obvious to users that `sparse -h submit` and `sparse submit -h` will return different help messages. (Issue 334)
- We now provide a universal wheel on PyPI (commit f600c98)
- `sparse kill` can now kill any topology and not just those that have a definition in your `topologies` folder. (commit 66b3a70)

Fixes
- Fixed Python 3 compatibility issue in `sparse stats` (Issue 333) an issue where `name` was being used instead of `override_name` when calling pre- and post-submit hooks. (10e8ce3)
- `sparse` will no longer hang without any indication of why when you run it as `root`. (Issue 324)
- RedisWordCount example topology works again (PR 336)
- Fix an issue where updating virtualenvs could be slow because certain versions of fabric would choke on the pip output (commit 9b1978f)

3.2.0

This release adds tools to simplify some common deployment scenarios where you need to deploy the same topology to different environments.

Features
- The `par` parameter for the `Component.spec()` method used to set options for components within your topology can now take dictionaries in addition to integers. The keys must be names of environments in your `config.json`, and the values are integers as before. This allows you to specify different parallelism hints for components depending on the environment they are deployed to. This is very helpful when one of your environments has more processing power than the other. (PR 326)
- Added `--requirements` options to `sparse update_virtualenv` and `sparse submit` commands so that you can customize the requirements files that are used for your virtualenv, instead of relying on files in your `virtualenv_specs` directory. (PR 328)
- pip is now automatically upgraded to 9.x on the worker nodes and is now run with the flags `--upgrade --upgrade-strategy only-if-needed` to ensure that requirements specified as ranges are upgraded to the same version on all machines, without needlessly upgrading all recursive dependencies. (PR 327)

Fixes
- Fixed an issue where `name` was being used instead of `override_name` when calling pre- and post-submit hooks. (10e8ce3)
- Docs have been updated to fix some RST rendering issues (issue 321)
- Updated quickstart to clarify which version of Storm is required (PR 315)
- Added information about flux-core dependency to help string for `sparse run` (PR 316)

3.1.1

This bugfix release fixes an issue where not having `graphviz` installed in your virtualenv would cause every command to crash, not just `sparse visualize` (311)

Page 4 of 8

© 2024 Safety CLI Cybersecurity Inc. All Rights Reserved.