Hacker Newsnew | past | comments | ask | show | jobs | submit | celoyd's commentslogin

Done. Thank you!


Sorry. If there’s one thing I’ve learned from this project, it’s that video support is hard.

I’m happy to take advice (preferably in the form of ffmpeg flags).


What were your ffmpeg flags to begin with?


It’s based on the example for 2-pass encoding, with tweaks for things like QuickTime support: https://gist.github.com/celoyd/90cc919105248a2ddc95


Well-worn gray: https://en.wikipedia.org/wiki/Albedo

It’s a loose comparison, since both asphalt and the moon’s surface vary. Plus, there are tricky things like specular reflection and the opposition effect.

How can its color be compared to something on earth? Doesn't the (lack of) atmosphere have some effect?

You can hold a moon rock up against something on Earth. Or you can look at Earth and the moon from a distance with the same sensor, which is what Himawari-8 is doing.

The atmosphere does affect things: A huge plain of moon rocks on Earth’s surface would look bluer (hazier) than the moon would in the same picture from Himawari-8 (or an Apollo Hasselblad, etc.). And a moon rock in sunlight on Earth will look slightly yellower than one in the same light on the moon. But your eyes are constantly adapting to the surrounding illumination. Color perception is really complicated.


Casual readers may not get your reference – the idea for DSCOVR literally came to Al Gore in a dream. I still think this is hilarious.

One can indeed argue that DSCOVR has merit, and people including climate scientists do. (Though arguably it’s really too early to judge either way until there’s time for publications to come out of its data.) Earth’s radiation budget is surprisingly underdetermined, considering its importance.

But it’s certainly a fair criticism of DSCOVR as launched that it’s not state-of-the-art. That’s because it was delayed for reasons of politics, only loosely disguised as reasons of science.

The only places I’d push back on your remarks are:

1. The “Uh no”, which is unsubstantiated (perhaps just facetious, but I’m sensitive because I supported my point relatively laboriously, with the links); and

2. the idea that the NYT should refrain from pointing out political interference in science funding.


38 million was loose change, even in 1998. We spent far more teaching abstinence (with little to no effect) to school children that year.


Which is why I linked directly to a NY Times peace that gives a fairly balanced discussion of the same.

And it is not fair to claim that it was, "only loosely disguised as reasons of science." The reasons given, in both the Inspector General's report and in the article that I linked to are political reasons of _budget_.

It is not unsubstantiated as I substantiate it via link. I'm also a person that opposed the launch. As others point out, it wasn't _fabulously_ expensive in comparative scale, but in a very stretched NASA budget I would prefer all the pennies thrown at a mars exploration, a permanent moon base, a better space station, or a new shuttle program over a really cool camcorder inspired by a VP's (very literal) dream. That isn't science so much as something bordering on dictatorial whim.

Nor, _anywhere_ do I claim the NYT should somehow not report on science funding. I link directly to it to refute _your_ comments. The NYT article does not support your claim, instead it gives a much more reasonable account of the funding issue. It mentions the dream, the funding, and doesn't resort to slurs.


I think they’re just responding to my joke with a joke ;)


I didn't find it a joke and the votes indicate others took it seriously (down votes are serious).


I made this, and I’m happy to answer questions. (And to politely ignore contentious remarks about how I characterized GOES-R.)


I'd love to have something like this as an animated desktop wallpaper - but it should be moving much slower. Are you aware of a movie file that I could use for this?


I wrote a script that downloads the live (well, every 10 minutes, with 30 minutes delay) tiles from the himawari-8 website and update my background with it. Gnome is nice enough that it refreshes the background when the configured image changes.

I'm waiting for the solar eclipse in March, it should be (indirectly) visible. http://www.timeanddate.com/eclipse/solar/2016-march-9


Sounds nice, do you have it up somewhere?


Now on https://github.com/glandium/himawari-wallpaper (I'm not actually sure the eclipse will be visible on the cut I'm using)


Thanks!


Try xplanet.

Xplanet can render to the background and keep an updated view of earth. At some point I obsessed over having current cloud cover images overlaid and that looked really nice. It can even render sun reflections.


Thanks for the super informative FAQ in Credits/About - for others visiting the site, be sure not to miss it on top left!


Thanks! This was increadable to watch over and over again. I'm so used to highly compressed video, that the detail in this was staggering.

Is there a good public reasonably live feed of this data? I found the 800x800 8 bit pngs, and I found information on the restricted access full sized 103 gigabyte per day feed.


Is there a good public reasonably live feed of this data?

Right here: http://himawari8.nict.go.jp


How awesome would it be if we had that kind if quality available from all "sides"... (Ok, yes, one could mostly build displays of blue spheres. But fancy ones ;))


Any reason why we don't have several of these at all points?; or do we and I just do not know about it? - p.s. love the site, thank you


Europe’s weather authorities are extremely stingy with their nearest equivalent data – their attitude is that the observations are for science or for money, not for silly websites.

Feel free to provide an email address for us to complain.


Click "Credits/About" on the OP.


Fantastic! Thank you! I've cropped several as desktop wall paper.


Why not make a cron job that does that automatically every couple minutes ;)


That's the plan! It just need to be intelligent enough to find interesting lighting.


There's another satellite, DCSOVR, that takes photos of the daylight side of the earth several times a day. It's not as up-to-date as this footage, but it's always fully lit. http://epic.gsfc.nasa.gov/


Wow, DSCOVR. typo


In addition to the link posted by celoyd, you can get access to the full data stream you mentioned by filling out this application form[0].

There are also some heavily processed images from that data available from NOAA[1] - the "Geocolor Full Disk" is the best, it's half-resolution (5500x5500). The green filter on Himawari's camera doesn't correctly capture the green color of vegetation, which is why OP's video looks browner than you might expect. So this product attempts to correct for that by creating an artificial green channel made of a combination of other channels[2]. It also attempts to correct for Rayleigh scattering[3], so this is basically what the Earth would look like if the atmosphere suddenly disappeared (except for the clouds :P). The night portions of these images are a different kind of false color composite: the clouds come from two infrared channels, white are high ice clouds and red are low wet clouds; the city lights are (sadly) just a static overlay from existing data.

And (shameless plug) I've been playing with applying motion interpolation algorithms to these NOAA images to create smooth, high resolution video that can be played much slower. The Farneback optical flow algorithm[4][5] seems to work very well. (Lots of) videos available on my Youtube channel[6], code/details available here[7][8], blog post coming soon :)

[0] http://www.eorc.jaxa.jp/ptree/registration_top.html [1] http://rammb.cira.colostate.edu/ramsdis/online/himawari-8.as... [2] http://www.goes-r.gov/downloads/ScienceWeek/2015/Presentatio... [3] http://rammb.cira.colostate.edu/research/goes-r/proving_grou... [4] http://www.diva-portal.org/smash/get/diva2:273847/FULLTEXT01... [5] https://github.com/dthpham/butterflow [6] https://www.youtube.com/watch?v=6rOwjn87edI&list=PLrmCQL5hEL... [7] https://github.com/dandelany/animate-earth [8] http://www.unmannedspaceflight.com/index.php?showtopic=8063&...


Wow. Great stuff! Is there a good way to use one a video at a very low framerate (perhaps 0.1-1 fps) with low resource requirements as animated wallpaper on Ubuntu/Linux?


Oh, hello! I enjoyed your motion interpolation experiments, and I look forward to the blog post.


Awesome work and thanks for the helpful links. Would make a really cool background / screensaver to loop the prior days imagery in HD :)


This is great, but it would be nice if there were a way to slow it down a bit.


document.querySelector('video').playbackRate = 0.1;


Cool demo. On my machine though (high-dpi monitor, win10, firefox) the globe is enormous and way too big for the browser viewport. If I zoom out enough with ctrl-minus it is about the right size, so I think you're sizing the page elements incorrectly in some sort of dpi-unaware fashion. Can probably work around this with devicePixelRatio.


I know it’s odd, but I wanted it not to be visible all at once.


FWIW, I really appreciated this. I think it helped add to the feeling of enormity, and helped me to realize the resolution of the video.


FWIW I don't think ‘enormity’ means what you think it does!

‘Enormity’ refers to severe moral transgression, like you could say, “It wasn't until after the war had ended that the German people became aware of the enormity of Hitler's concentration camps…” That's closer to what the word means.


I appreciate that choice, but maybe add a zoom out button to notify people that you can in fact zoom out, because I didn't even realize I could see the whole earth (Also, this made the 'what is that bright spot moving east to west' question very confusing).


<ctrl>-

Repeat as necessary.

Went too far?

<ctrl>+

When done, <ctrl>0

(on chrome at least)


Thanks for making it! I tried a little with your scripts and got to these results: (original files available if you ask)

1 Day in 4400x4400: https://www.youtube.com/watch?v=m4_orOM8zOg

1 Month: https://www.youtube.com/watch?v=NwN2KJcQfoQ

11000x11000 Sunset: https://i.imgur.com/wMIXQvC.jpg

11000x11000 Daylight: http://i.imgur.com/y1zTyU2.jpg


How come you pointed it at Australia and not NZ :(

Also, it'd be nice to be able to pause it and really take in the colours.


https://s3.amazonaws.com/hi8/v/2015-08-03.mp4

There's the raw video. Added bonus is that it actually fits in the full browser window when viewed directly.


Thanks. It's a 2200x2200 24fps H.264 video (33MB).


Also, it'd be nice to be able to pause it and really take in the colors.

You can zoom in on the NICT browser: http://himawari8.nict.go.jp

Their color mix is more cloud-oriented, so it’s darker, but at least the image quality is higher than the video’s.


In Firefox at least the context menu includes "Pause".


Beautiful, thanks for sharing.


Beautiful! Well done.


Discovery at Udvar-Hazy is why I started this project. I saw the serial numbers on the tiles – almost close enough to touch on tiptoe – and remembered reading about some kind of database. I imagined a visualization with a line for every tile over time, and decided to find the records to make the viz.

That was two years ago. I’ve asked a lot of people since then, but after making a web site for the project (on @doingitwrong’s advice), this week is by far the most attention it’s gotten. I’m hoping this is what finally gets word to someone who knows something.


> The environmentalist threw a fit about this "glue" and it was replaced with a glue that all the engineers said was not as safe, in regards to the tiles staying attached...

This is a common myth. It’s false: http://mediamatters.org/research/2005/08/09/limbaugh-promote...


This is a great telling of the myth though: http://news.heartland.org/newspaper-article/2003/09/01/did-e...


Reading a false story is dangerous -- the mind tends to remember the story, and forget the "It's a myth" part over time.

This is also why "Myth vs Facts" or sarcastic "How to do X Very Wrong" articles are bad style -- they undermine the goal. Better to write using language that affirms the truth, not multiple negations.


> the mind tends to remember the story, and forget the "It's a myth" part over time.

I find the opposite to be true. Once I've identified something I thought to be once true was in fact misleading/wrong/a myth, it seems to be forever stamped as a falsehood in my brain. Likewise when I know going into it reading it that it is a myth/false.


Ah, thanks. I was looking for it. I deleted the main comment because I didn't want a conspiracy war breaking out lol.

But everywhere I did read, the tiles have been a plague on the Orbiter since day 1. And of course the man hours needed to change them was crazy.


That part is true. Orbiters would routinely come back with broken or missing tiles. Fortunately it was robust enough to withstand a few missing.


Fixed (I hope). Thanks for reporting.


I'm seeing a flash of lines, a flash of text, and then it all disappears. Tried in chromium, google chrome, and firefox, similar behaviour on all three.

edit: just to confirm, i did clear all caches to pull in any new style etc


How odd. I just switched fonts entirely (though still from Google Fonts). If anyone has a sense of what’s going on here, I’d love to fix it properly.


It looks great in Safari (not that this helps the folks for whom it doesn't look great for)


Not sure what the problem is but your current fix is working :)


I'm also seeing the issue with Firefox 39


I wrote that Mapbox post, and helped with some of the processing that happens to get this data on AWS. Yep, you get multispectral resolution of 30 m, and with pansharpening (http://en.wikipedia.org/wiki/Pansharpened_image, etc.) you can get visually acceptable quality at 15 m in RGB.

Landsat is basically intended for science about seasonal/annual/decade-scale changes in Earth’s land surface. When you see an estimate of how a city’s built-up area has grown since 1980, or how the Everglades are changing, it probably has Landsat as one source. This explains a lot of design decisions that might seem weird to a layperson who wants to use it for everyday RGB imagery. Most use of Landsat imagery is basically off-label. It’s just very good data in terms of accuracy, precision, and general ease of use. And if I say so myself, it looks real pretty: https://www.mapbox.com/blog/landsat-live-live/


Which pansharpening method is used in the example image?


In the images in the blog post and the live map? Those aren’t pansharpened at all. If we do add pansharpening in a later version, it’ll likely be naïve, without spatially aware modeling of the multispectral data. (Specifically, it’ll probably be a cleaned-up, rasterio-based, null-aware, parallelized descendant of this sketch of the Brovey transform in numpy: https://gist.github.com/celoyd/2e7beed82951d22b9b90 .)

From what I’ve seen – and I haven’t tested it carefully yet, so I could be wrong – the more elaborate methods are severe overkill on Landsat 8. It has only 4 pan px per multi px (where some commercial data has 9 or 16), and the pan band is almost exactly R+G+B (without NIR). So my gut and some simple experiments suggest that doing PCA-or-whatever is overthinking it.


In the blog post

> Pansharpened Malibu, 15 m (50 ft) per pixel. Notice the wave texture in the water.

Ugh, Brovey. There's better options available. Like MMP (really low spectral distortion but can be slow): http://ieeexplore.ieee.org/xpls/abs_all.jsp?arnumber=6677587) or even affinity/guided filtering (my own paper, more spectral distortion than MMP but a lot faster and you can sharpen hyperspectral with multispectral or RGB): http://ieeexplore.ieee.org/xpls/abs_all.jsp?arnumber=7008094.


Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: