Google is making private AI practical with homomorphic encryption(blog.google)
491 points by u1hcw9nx 7 days ago | 283 comments
tl;dr: Google has released HEIR, an open-source compiler that converts pre-trained AI models to run inference on homomorphically encrypted data, letting servers process ciphertexts without seeing the underlying inputs. The project has attracted partnerships with hardware accelerator startups (Belfort, Niobium, Cornami, Optalysys) and several universities, and Google is demonstrating it with four applications: recommendation models, credit card fraud detection, network intrusion detection, and hotword detection. Benchmarks are currently single-threaded CPU, with accelerator latency numbers promised soon.
HN Discussion:
  • HE overhead (~1000x) makes it commercially impractical for AI inference
  • Local models on your own hardware provide better privacy without the massive resource cost
  • This is a funding-motivated pivot by FHE researchers to attract AI-hyped executives
  • Skepticism about Google's privacy credibility given their other products
  • ~Genuine curiosity about practical use cases where HE would beat alternatives