AI startup launches ‘fastest data processing engine’ on the market
source link: https://thenextweb.com/news/ai-startup-launches-fastest-data-processing-engine-market
Go to the source link to view the article. You can view the picture content, updated content and better typesetting reading experience. If the link is broken, please click the button below to view the snapshot at that time.
AI startup launches ‘fastest data processing engine’ on the market
Female-led Pathway says its system can 'forget' in real-time, like a human
Paris-based and female-founded AI startup Pathway has announced the general launch of its data processing engine. Reportedly, it is up to 90x faster than existing streaming solutions, and promises to be the “fastest data processing engine on the market.”
The secret? A unique ability to mix batch and streaming logic in the same workflow, which lets the system forget things that are no longer useful. Basically, this means it can learn and react to changes in real-time — like humans.
Traditionally, the complexity of building batch and streaming architectures has resulted in a division between the two approaches, says Pathway CEO and co-founder Zuzanna Stamirowska.
This, she adds, has slowed down the adoption of data streaming for AI systems and fixed their intelligence at a moment in time. Not to mention the added complexity of a third workflow — generative AI.
According to Stamirowska, there’s now a “critical need” for rapid data processing and more adaptable AI. “That’s why our mission has been to enable real-time data processing, while giving developers a simple experience regardless of whether they work with batch, streaming, or LLM systems,” she states.
The <3 of EU tech
The latest rumblings from the EU tech scene, a story from our wise ol' founder Boris, and some questionable AI art. It's free, every week, in your inbox. Sign up now!
Stamirowska says Pathway’s aim is to give developers a simple experience, regardless of whether they work with batch, streaming, or LLM systems. Credit: Pathway
Revisions to data points without AI retraining
Machines “forgetting” incorrect or outdated information in real-time has been a near-impossible feat in the past, due to models being trained on static data uploads. Traditionally, unlearning would require retraining of the model.
Indeed, when we put the question to ChatGPT for fun — can you unlearn things should they prove to be inaccurate — this is the response we received:
“As an AI language model, I don’t have the ability to “unlearn” information in the same way humans do.
“However, the developers and researchers at OpenAI can update and retrain the model based on new data and improvements.”
But Pathway says it can make revisions to certain data points without requiring a full batch data upload, akin to updating the value of one cell within an Excel document. The updated cells doesn’t reprocess the whole document, but just the cells dependent on it.
One of the startup’s existing clients, German logistics specialist DB Schenker, reduced the time-to-market of anomaly-detection analytics projects from three months to one hour. Meanwhile, French postal services company La Poste saw a fleet CAPEX reduction of 16%.
‘Lingua franca’ for developers
Polish-French duo Stamirowska and Claire Nouet, the company’s COO, founded Pathway in 2020. Thus far, the startup has raised $4.5mn (approx. €4mn) in a pre-seed round December last year, and counts 20+ employees across Europe and North America.
The female-led deep tech startup is hoping for its system to become a “lingua franca” of all data pipelines (stream, batch, and generative AI). Beyond cutting costs for clients, it says it is looking to democratise the ability for developers to design streaming workflows, which have typically required a specialist skill set.
Recommend
-
144
By Jon Bratseth, Distinguished Architect, VespaEver since we open sourced Hadoop in 2006, Yahoo – and now, Oath – has been committed to opening up its big data infrastructure to the la...
-
5
The Fastest Growing Sectors of Startup Fundraising in 2020 Posted on 2021, Jan 18 2 mins read From time to time, I chart the fastest g...
-
4
TechThe PC market just had its best Q1 since 2015 and fastest growth in 20 yearsPublished Mon, Apr 12 20215:25 PM EDTUpdated Mon, Apr 12 20216:03 PM...
-
6
Mutad The name Mutad is a reverse spelling of datum. Overview An end-to-end implementation of a real-time data platform/search engine based on various technology stack. The implementation is rather for my own learning...
-
6
Victrix launches ‘world’s fastest’ Xbox controller and Gambit wireless headset Join gaming leaders online at GamesBeat Summit Next this upcoming November 9-10.
-
9
Current Market Trends For The Fastest-Growing SMB Industries Do you have a small- to medium-sized business? As you know, to stay competitive in any market, you m...
-
4
The nation's fastest communitywide internet? New 25-gig service launches at $1,500 per monthSaleen Martin, USA TODAYSat, September 3, 2022, 7:50 AM·5 min read
-
1
Xpeng launches SUV model G9, calling it "the world's fastest-charging EV" Xpeng launches SUV model G9, calling it "the world's fastest-charging EV" 12 hours ago Chinese electric vehicle startup...
-
4
What you need to knowVerizon is giving potential customers a 30 day trial of its network on eSIM-compatible phones with Verizon Test Drive.Verizon Test Drive works on iPhone and Android devices w...
-
3
AnTuTu: Here are the fastest Android smartphones in the market
About Joyk
Aggregate valuable and interesting links.
Joyk means Joy of geeK