The Author Online Book Forums are Moving

The Author Online Book Forums will soon redirect to Manning's liveBook and liveVideo. All book forum content will migrate to liveBook's discussion forum and all video forum content will migrate to liveVideo. Log in to liveBook or liveVideo with your Manning credentials to join the discussion!

Thank you for your engagement in the AoF over the years! We look forward to offering you a more enhanced forum experience.

468265 (4) [Avatar] Offline
#1
Hello,

I wanna use Kafka as a data warehouse of events, and I am concerned of scalability because of partition per node: what happens when we can’t scale up the machine, how do we get around this?

I might be confused and not have understood how Kafka works... or maybe is just to process the events and not to store them and query them as a database... any thoughts?