Back to the social media.
Was debugging #Spark again for several previous days. Things that I've learnt during another deep debugging session:
1. It seems that it doesn't like when you try reading old checkpoints
2. Do not use different schemass for serialization in same application, or you will spend a lot of time debugging them.
3. #Scala is statically typed language that allows you to make things you can do in #Python, but with guarantee that if it compiles then it will at least work.
This Mastodon instance is for people interested in technology. Discussions aren't limited to technology, because tech folks shouldn't be limited to technology either!