This Week in Fluvio #30

Fluvio is a distributed, programmable streaming platform written in Rust.

This Week in Fluvio is our weekly newsletter for development updates to Fluvio open source.

Please subscribe to This Week in Fluvio to receive new posts in your inbox

Subscribe to Newsletter

Subscribe

Congratulations! You are enrolled to receive our newsletter.

Please check your email to confirm your account.

Registration failed for the following reason:

Close

• Fluvio v0.9.24
• DynamoDB Sink connector (Unsupported as of Fluvio v0.10.0)
  • The Dynamodb Sink Connector is a sink connector which reads events from a Fluvio topic, deserializes them as json and inserts those key value pairs based on the columns in the config.
• Slack Sink connector (Unsupported as of Fluvio v0.10.0)
  • The Slack Connector is quite simple. It will stringify any record coming from a Fluvio stream and POST it to the slack via a slack webhook url

• Storage: Enforce size based retention for topic (#2179)
  • Previously, Fluvio supported only a time-based retention policy for data in a topic. For some workloads, it was inconvenient as it was needed to consider the incoming data pace to properly calculate retention time to fit the data into the available storage size. With this new feature, you can tell Fluvio what is the maximum size of the partition you want, and it will control it for you. Check out the details in Data Retention.
• Export cluster profile to a file (#2327)
  • Can be used to initialize the connection to a Fluvio cluster via client APIs.

• Don’t try to use directories as smartmodule if passed as argument (#2292)
• CLI: Migrate all fluvio crates to comfy-table from prettytable-rs (#2285)

• Real-time Gaining Momentum in the Enterprise
  • Grant shares how legacy data infrastructures operate and how Infinyon with Fluvio’s community are positioned to leverage modern technology for faster and higher quality data infrastructures.

• Infinyon was featured as a one of The 18 Most Exciting Startups Building with Wasm
  • Our CEO, A.J. Hunyady, answered questions about our decision to use WebAssembly, and how we use it in Fluvio and Infinyon Cloud.

• Sr Rust Engineer (Frontend) [Remote - Global]
• SW Engineer (Cloud services) [Remote - Global]
• Sr SW engineer (Connectors) [Remote - Global]
• Sr Rust engineer (Infrastructure) [Remote - US]
• Developer Advocate [Remote - US timezones +/- 5hr]
• Solutions Architect [Remote - US timezones +/- 5hr]

Get in touch with us on Github Discussions or join our Discord channel and come say hello!

For the full list of changes this week, be sure to check out our CHANGELOG.