Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

What's the performance penalty?


Pretty bad, but in a lot of cases you can use this to set up some kind of dataflow graph you use for long enough to amortize the overhead.



Yeah, it's a very widely used technique to use slow scripting languages (with or without operator overloading) to set up some kind of graph describing a computation that takes a lot longer to run than the scripting-language statement takes to interpret. In addition to Beam, we could mention the Unix shell, Pandas, Numpy, TensorFlow, SQL, SQLAlchemy, APL, Lush, PIL, CSS, some Linux system calls like sendfile(), maybe Apache SPARK, etc.


You wouldn't use it in any situation where performance is important...




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: