Free Lossless Image Format (FLIF)

Discussion in 'Offtopic Discussions' started by _wb_, Sep 6, 2015.

  1. _wb_

    _wb_ Microbe Staff Member

    Joined:
    Apr 5, 2012
    Messages:
    5,387
    Location:
    Brussels, Belgium
    I'm working on a new lossless image compression algorithm, called FLIF.

    It compresses better than PNG, lossless JPEG 2000, and Google's WebP format in lossless mode.

    It's also better at progressive decoding of partially downloaded files. Here's a little demo of that, comparing FLIF to PNG with Adam7 interlacing:

    https://www.youtube.com/embed/ByH7RMsMxBY?feature=oembed
     
    Last edited by a moderator: Sep 6, 2015
    Tags:
  2. Linux-SWAT

    Linux-SWAT Hardcore Member

    Joined:
    Feb 13, 2010
    Messages:
    8,070
    Is the compression also faster ?

    Which licence will you use ?
     
    Last edited by a moderator: Sep 6, 2015
  3. _wb_

    _wb_ Microbe Staff Member

    Joined:
    Apr 5, 2012
    Messages:
    5,387
    Location:
    Brussels, Belgium
    No, not faster.


    License will be GPL. Maybe LGPL for a library version.
     
    comradekingu and ible like this.
  4. Exophase

    Exophase Nothing good will ever come of Exophase.

    Joined:
    Sep 21, 2006
    Messages:
    10,308
    Location:
    Cleveland OH
    Sounds like it's really something, one person beating all these long established algorithms. Phenomenal work.

    Do you think you'll be able to post technical information on the algorithm soon?
     
    Neelix likes this.
  5. ekianjo

    ekianjo Hardcore Member

    Joined:
    May 7, 2012
    Messages:
    8,261
    Location:
    神戸市、日本 (Japan)
    Impressive work - looking forward to when you release it.
     
  6. EvilDragon

    EvilDragon Administrator Staff Member

    Joined:
    Mar 4, 2003
    Messages:
    19,438
    Location:
    Ingolstadt
    Wow, very very interesting.

    Especially in seeing HOW MUCH more it compresses compared to PNG!

    I expected a few bytes, but it actually is A LOT of bytes :eek:

    I love that. I especially love optimizing such things in a world where most don't even care about that anymore (as everyone thinks it's not worth it because computers are fast enough and size doesn't matter)

    Great work!
     
    rygD and Tenka like this.
  7. ptitSeb

    ptitSeb Serial Porter

    Joined:
    Aug 15, 2012
    Messages:
    8,180
    Location:
    France, near Lyon
    Impressive work and impressive results!
     
  8. SONY

    SONY PlayStation

    Joined:
    Oct 8, 2005
    Messages:
    12,411
    Location:
    Melbourne, VICTORIA - AUSTRALIA
    Awesome stuff, mate. As usual, OpenPandora.org is the place to be! :D
     
  9. benoitb

    benoitb Very Active Member

    Joined:
    Jan 13, 2011
    Messages:
    616
    Location:
    Finland
    Good stuff. Even for lossy, at only 20% of the download, your render already looks excellent.
     
  10. Kev2442

    Kev2442 Still French

    Joined:
    Nov 4, 2014
    Messages:
    542
    Location:
    42 (Loire) is the answer.
    Sounds awesomely impressive.

    How does it compare to acceptable-quality JPEG compression ?

    As a user of lossless formats, I'm quite interested.

    OpenPandora.org definitely is the place to be. ^_^
     
  11. Ziz

    Ziz Advanced Member

    Joined:
    Sep 10, 2006
    Messages:
    1,584
    Quite interesting. Looking forward to more details!
     
  12. Magic Sam

    Magic Sam Forever Homebrew

    Joined:
    Aug 10, 2007
    Messages:
    2,118
    Location:
    Innsmouth, MA
    Hi :)

    I love these new image formats ! It reminded me of BPG, execpt FLIF is not patent encumbered (AFAIK).

    @ _wb_: keep up the good work !

    Cheers, Magic Sam
     
  13. moxie

    moxie The voice of reason, sense and exasperation Staff Member

    Joined:
    Aug 15, 2006
    Messages:
    2,707
    Location:
    South of Sweden
    I'm suitably (and that means: very!) impressed :D
     
  14. fusion_power

    fusion_power Advanced Member

    Joined:
    Dec 11, 2006
    Messages:
    6,927
    Location:
    germany
    I share that Philosophy. :)

    Well, not sure if the World needs another Image Format, we already have to many of everything there imho, but it's nice to see what's still possible in already established areas. Now please make something that reduces Video bandwidth without loosing quality. Youtube & Co. really need that (their image quality sucks balls, even on their "HD"! ). -Yes, I have slow Internet but like to watch Streams, I'm trained to suffer. XD
     
    Last edited by a moderator: Sep 6, 2015
  15. mcobit

    mcobit Advanced Member

    Joined:
    Jul 28, 2008
    Messages:
    6,755
    Wow. That is really impressive. I like it a lot.


    So ut has the same features as png? But saves 1/3rd of the size and has better progressive display properties? Sell it to google ;-)
     
  16. ible

    ible Advanced Guard Tower

    Joined:
    Mar 24, 2014
    Messages:
    2,080
    Location:
    Thrice in CA, twice in ND, once in the NL
    how well does it compare in file-size to BPG?  interested in checking out the source eventually.  will you use git or something else?

    [edit]also, any hints as to the idea behind the compression?
     
    Last edited by a moderator: Sep 6, 2015
  17. _wb_

    _wb_ Microbe Staff Member

    Joined:
    Apr 5, 2012
    Messages:
    5,387
    Location:
    Brussels, Belgium
    I'll do a compression comparison with some other formats, I'll include BPG too.

    I'll put the source on github.

    Some of the main ideas behind the compression:

    - it uses CABAC for entropy coding, just like FFV1

    - for interlacing it uses a generalization of PNG's Adam7; unlike PNG, the geometry of the 2D interlacing is exploited heavily to get better pixel estimation, which means the overhead of interlacing is small (vs simple scanline encoding, which has the benefit of locality so usually compresses better)

    - the colorspace is a lossless simplified variant of YIQ, alpha and Y channel are encoded first, chroma channels later

    - the real innovation is in the way the contexts are defined for the arithmetic coding: during encoding, a decision tree is constructed (a description of which is encoded in the compressed stream) which is a way to dynamically adapt the CABAC contexts to the specific encoded image. We have called this method "MANIAC", which is a backronym for "Meta-Adaptive Near-zero Integer Arithmetic Coding".

    I'll have to write a paper about this at some point to explain everything.
     
    ible likes this.
  18. ZXDunny

    ZXDunny Deep avatar

    Joined:
    Oct 12, 2010
    Messages:
    2,490
    You should pass the image through the google neural network, and compress it based on its findings:

    "Dog, small, Chihuahua, name of 'bob' at 100,240"

    You'd save masses in image compression.

    D.
     
    _wb_ likes this.
  19. FelixNemis

    FelixNemis Member

    Joined:
    May 15, 2012
    Messages:
    279
    This is really cool, I'd also like to see compaison of compression/decompression speed compared to others.
     
  20. WizardStan

    WizardStan Mega GP Mania

    Joined:
    May 24, 2008
    Messages:
    16,589
    Brilliant work, I copy Exophase's sentiment, pretty amazing to beat out such long standing formats.

    Now I challenge you to write a codec for the Pandora's DSP for it :p
     

Share This Page

Loading...