Distributed Domain Destruction - Adventures in building distributed systems

In the last three years I have been building, maintaining and fighting a few projects that make use of distributed computing and parallel processing. I live with message brokers, queues, workers, publishers and subscribers daily. This is a talk that will try to convey some of the pitfalls and solutions you will encounter along the way, in hope that you will have an easier time circumventing them when it is your turn to battle them.

The project has grown enough that it requires refactoring, and extracting pieces of it to be distributed to different machines and places. Of course it should work like a well oiled mechanism, but it may not... at first.

For the last three years I have been building, maintaining and fighting a few projects that make use of distributed computing, parallel processing, message brokers, queues and workers. This is one of those "from the trenches" talks, where I will regale you with tales about the series of unfortunate events that may happen as your application grows in complexity. Tales like disk space fluctuations, importance of logging, NoSql problems, restructuring your order of execution in code for performance gains, short sighted albeit logical architectural decisions that will cost you in the long run.

Come hear about the agony you will experience when it starts falling apart, and the thrill you will feel when everything is running juuust right.

Skill level: Intermediate
Duration: 25 min
Photo of Srdjan Vranac
Srdjan Vranac

I am a developer, consultant, mercenary (used to be known as freelancing). I lead a small team that works on various projects ranging from small family businesses to Fortune 500 companies. I write terrible code that performs exceptionally and currently I am wrangling elePHPants and Pythons.... My Interests are process automation, continuous integration and delivery, clean code, testing, best practices (you have to know them so you can break them if you have to), distributed systems

Supported by

Organized by