DeepX has taped out its second-generation AI inference chip, claiming the ability to run models up to 100 billion parameters while consuming under 5 watts. The architecture leverages LPDDR5X Processing-in-Memory (PIM) technology to achieve a projected 6.7x performance improvement over its predecessor.
Read original
hackernews