Create a lightweight version of Nvidia Neural Texture Compression. It should be lightweight enough to allow decompression directly in the shader. Cut the texture into smaller tiles and create a model for each tile independently. This should result in smaller models and faster evaluation for each tile.
If you are interested in this topic or for more information please contact Prof. Helmut Hlavacs (helmut.hlavacs(at)univie.ac.at).