Edited: fix a typo and clarify public vs key pair.
Unlike ngrok, and they are a great product, I have used them for years, we are completely open source. Further we are peer to peer, so if you and the other party both want to communicate, you can do it without any dependency on a third party/company.
The last bit requires some explanation, but this is provided by iroh, this is not our innovation, we have simply used iroh and benefitted from it, you can read about their node discover process here [1], there is some initial reliance on a relay, which is currently run by them, and we hope to run our own relays in future.
Right now the way it works is `malai http 3000` listens over iroh, and creates a public private key pair, public part of the key is used as node identity, which we call id52 (52 char public key, default iroh public key representation are 64 char and not suitable for using as a subdomain).
Then on kulfi.site server, `malai http-bridge` runs, which starts an HTTP server, and any request that comes for `<id52>.kulfi.site` lands on this HTTP server, which then connects to `malai http` instance over iroh network using the id52[2]:
`malai http` gets the HTTP request payload, and makes a HTTP request to the port 3000 (on localhost), and sends the request, and then the return is returned back all the way from malai http to malai http-bridge to the client who made the original request.
We are currently running an instance of the `malai http-bridge` on `kulfi.site`, and you can run your own if you do not trust us for example, go ahead, we encourage it, not for trust, but so it keeps our bandwidth bills down.
But you do not have to use the http bridge, you can run `malai browse kulfi://<id52>`, and it will start a local http-bridge (it will run single target node as for localhost you can not use subdomains to extract the id52 from, which is why you have to pass it on CLI). `malai browse` opens a HTTP server on some random port, and opens your default browser with it, and rest works the same.
If you are curious, kulfi is the main project, we are creating a tauri powered web browser, which will directly speak iroh, and will not require the http bridge, the http request from browser will straight go over iroh network to the other side.
I found crawlee a few days ago while figuring out a stack for a project. I wanted a python library but found crawlee with typescript so much easier that I ended up coding the entire project in less than a week in Typescript+Crawlee+Playwright
I found the api a lot better than any python scraping api till date. However I am tempted to try out python with Crawlee.
The playwright integration with gotScraping makes the entire programming experience a breeze. My crawling and scraping involves all kinds of frontend rendered websites with a lot of modified XHR responses to be captured. And IT JUST WORKS!
Thanks a ton . I will definitely use the Apify platform to scale given the integration.
Ironically I started drafting this article in 2021, when I had to deal with a Django codebase littered with nested N+1 queries due to using the ORM in the most pythonic way.
In India a superhost Airbnb is very costly; a lot more than a decent hotel room very often.
In one of the cases the Airbnb was smelling of cigarettes and rotten food. Fortunately I was able to make a video of the entire shit and after a couple of follow-ups with Airbnb, got the refunds.
And after having similar and more issues with Airbnb, i look for a hotel room.
I used my T61 for 6 years and had to give it up because the graphic chip busted. Since then I have used multiple laptops Dell to Apple. I even installed Ubuntu on my Apple mac Pro, but it would not suspend and heat up inside my laptop bag.. finally shit blew up.
I have been using Xiaomi notebook pro for the last 8 months. Even with a hefty customs, it was cheaper by 80% for any laptop of the same configuration. The build quality feels like Macbook Pro. Ubuntu works out of box.. It suspends and everything works except the fingerprint reader.
The xiaomi notebook pro is as heavy as high end macbook Pro and the build quality is brilliant! The config is crazy and haven't faced a problem yet.
I check the quality of a good laptop by the how much the lid oscillates if you chuck it a little. Macbook Pro and xiaomi don't oscillate at all.. Dell, compaq, Asus oscillate a good 10-20 degrees.
Fundamentally these are not technology companies but companies driven by financial markets, cost saving _innovations_ and run more like the hospitality sector.
Most of them outsource their tech to the tech-outsourcing behemoths who are also run by man-month billing _innovations_
I see no hope of things improving drastically. Small incremental updates over decades till we invent teleportation... then they will die.
I was extremely enthusiastic about doing something in optimization just after graduating, but realised that businesses were happy solving things manually and reaching sub-optimal solutions. Also most problems needed to be solved once and there were few use cases of continuous optimization.
Thanks for sharing your story of perseverance and spirit.
Now that you are at it, are there any easy-to-use solutions to solve time-tabling problems for school/colleges. I know of solutions which use GA, but since its a generic problem for every academic institution, someone(you) might want to provide an easy to configure and use solution.
The "problem" with optimization software is that the fun optimization algorithms part is just 1% of the work. The software also needs to be complete enough to handle most of the everyday workflow of most employees at the users' company, or provide integrations to any other software that they use daily (from Excel to a custom calendaring system built by the founder's son 15 years ago).
Some friends are working on a courier dispatching system, which includes very clever optimization for choosing trucks and mapping routes. But most of the effort goes into making sure that the mobile app works on 5-year-old smartphones, and the fonts on the PDF invoices look right, and so on.
If you want to work on just the optimization algorithms, then that can be done only in academia or at very large companies which can afford specialization.
I have done .NET programming on windows for 3-4 years and felt the programming environment was pretty neat. The frustrating part was windows upgrades and the OS eating up all resources and the frequent need to upgrade the machine.
I switched to Linux(redhat and then ubuntu) for the next 8 years and loved vim and programming tools that linux had to offer. The resource utilization was never a blocker. The frustrating part was wireless drivers and machine hanging up because of them.
I recently shifted to OSX and installed iTerm/vim and all that. There have been no issues with wireless hardware and resource utilization. However, setting up production-like environment, which runs on Linux is a huge pain. Running a dual-boot ubuntu is also not as seamless and there are quite a few display driver issues. My take:
- If you have just started programming, start with Linux (if you haven't fought enough to compile drivers for your machine, you are one bit less of a real programmer)
- If you are doing a lot on the server side which largely is Linux driven, then you better use Linux to understand systems and deployment.
- If you are using eclipse, then you better shift to OSX because no other hardware-os combo at that price can let you code in peace.
