Korean Generative AI Firm Sues Hugging Face on ‘Batching’ Patent

“Large-scale” generative artificial intelligence company FriendliAI Inc. sued Hugging Face Inc. in a Delaware federal court alleging the Brooklyn, N.Y.-based company infringes one of the patents underlying its AI technology.

Hugging Face’s “Text Generation Inference” server for its large-language model AI uses FriendliAI’s patented method to batch incoming requests to increase the tool’s efficiency, according to a complaint filed July 28 in the US District Court for the District of Delaware.

FriendliAI’s method, which it calls “batching with iteration-level scheduling” and markets as Periflow or Orca, improved the process of batching inputs to allow the AI to process multiple requests ...