Read Project Naptha (projectnaptha.com)

Project Naptha automatically applies state-of-the-art computer vision algorithms on every image you see while browsing the web. The result is a seamless and intuitive experience, where you can highlight as well as copy and paste and even edit and translate the text formerly trapped within an image.

What the hand dare seize the ﬁre? ❧

I find it so heartening that one can use Project Naptha to highlight, copy and paste, and even edit and translate text formerly trapped within an image.

I’m further impressed that it also works with Hypothes.is!
–December 01, 2019 at 09:40AM

Though upon revisiting, it seems like the text is temporarily highlighted on Hypothesis (which probably only works with Naptha installed), then disappears, and the annotation is shown as an orphan.

Apparently Naptha only acts as a middle layer to allow the OCR of the image and that without it, the fingerprinting process Hypothes.is uses can’t find it after the fact.

Perhaps Hypothes.is could recognize that the highlighted text is being supplied by a third-party layer and instead of orphaning the highlighted text, it could anchor the highlight to the associated image instead? ❧
–December 01, 2019 at 09:44AM

Naptha, its current name, is drawn from an even more tenuous association. See, it comes from the fact that “highlighter” kind of sounds like “lighter”, and that naptha is a type of fuel often used for lighters. It was in fact one of the earliest codenames of the project, and brought rise to a rather fun little easter egg which you can play with by quickly clicking about a dozen times over some block of text inside a picture. ❧

Now if only I could do this with my Hypothes.is annotations! Talk about highlighting!
–December 01, 2019 at 10:06AM

There is a class of algorithms for something called “Inpainting”, which is about reconstructing pictures or videos in spite of missing pieces. This is widely used for film restoration, and commonly found in Adobe Photoshop as the “Content-Aware Fill” feature. ❧

This reminds me of a tool called asciinema that allows highlighting text within a video.
–December 01, 2019 at 10:13AM