
Daniel D. Gutierrez, Editor-in-Chief & Resident Knowledge Scientist, insideAI Information, is a practising knowledge scientist who’s been working with knowledge lengthy earlier than the sphere got here in vogue. He’s particularly enthusiastic about carefully following the Generative AI revolution that’s happening. As a expertise journalist, he enjoys conserving a pulse on this fast-paced trade.

All the time wanting ahead to an opportunity to return to my house away from house of Silicon Valley, I jumped on the alternative to attend my first-ever {hardware} centered convention, the 2024 AI {Hardware} and Edge AI placed on by Kisaco Analysis (#AIHardware2024). The occasion occurred Sept. 9-12, 2024 in stunning San Jose, Calif., the center of Silicon Valley. I used to be desirous to be taught what improvements have been happening on the {hardware} facet of AI. Boy, I wasn’t disillusioned! You largely hear about all the brand new advances in GenAI mannequin growth, however I see now that we’ll be listening to much more in regards to the quick-paced evolution of AI accelerated {hardware} to help these rising fashions at scale. AI {hardware} is advancing rapidly and I’m not speaking about NVIDIA Blackwell!

After selecting up my badge, I checked my schedule of chosen classes to attend, after which instinctively headed into the expo corridor containing all the businesses exhibiting new applied sciences. I knew kibitzing with the seller people readily available would yield the most effective use of my time on the present. I realized SO a lot after talking to many of the firms current.
Possibly a very powerful factor I realized, and one thing I stored listening to again and again, is that “{hardware} is cool once more.” It is because GenAI coaching and inference have hit considerably of a brick wall. In any case, what number of GPUs can you purchase? The nice factor is I spoke to many firms which are considering exterior of the field by creating options to the GPU, every with a big functionality vector and expertise density – suppose Cerebras, Furiosa, SambaNova, Groq, NeuReality, Etched, plus many others. NVIDIA has a present stranglehold over coaching (90%) and inference (40%), so the trade is ripe for change. Most of the new accelerated AI {hardware} options cater to inferencing – as they are saying, coaching is the way you make AI and inferencing is how you utilize AI. The primary factor I gathered from attending this convention is that change is within the wind. NVIDIA higher begin wanting over its shoulder as a result of very quickly now the corporate can have severe competitors (to not point out the corporate’s antitrust worries).
Taking part in my position as member of the Press, I make some extent of creating observations. One factor I seen was the variety of job interviews happening through the present. I noticed numerous stand-up interviews happening proper exterior the assembly rooms. Moreover, I witnessed numerous strategic conferences happening between firm principals, companions, and traders. In darkish corners of the resort foyer bar space, I overheard plans involving new merchandise, integrations, collaborations, and funding rounds. It was fairly invigorating to witness all the joy, with reminiscences of the heady days of the previous, and it led me to the view for the way vibrant the AI {hardware} area has grow to be currently.
Yow will discover numerous recorded speaker shows from the AI {Hardware} & Edge AI Summit HERE.
Location and Venue
Silicon Valley was the suitable location for the convention as many of the firms with their new AI {hardware} options have been native to the world.
The 1,300+ attendees have been housed in a single venue, the Signia by Hilton Lodge on Market Road. All the 2nd ground of the resort’s assembly space was dedicated to the present. This area appeared effectively sized for all involved. Plus, this resort was significantly high-tech – I by no means needed to work together with any human throughout my total keep as my reserving was 100% managed by the resort’s app (I didn’t even want a key for my room, the app unlocked my door when wanted!).

The Exhibition Corridor
The exhibition corridor was the point of interest of the convention. It was routinely filled with firms of their cubicles together with attendees. As well as, there have been overflow cubicles exterior the corridor within the adjoining hallways. Strolling by means of the convention space it at all times appeared jammed with individuals which to me simply elevated the joy.
Here’s a hand-selected brief record of firms from the convention that I previewed earlier.
The limitless espresso and snacks within the expo corridor have been drastically appreciated. One of many few criticisms I had for the occasion was the entire lack of seating to fulfill with firms, colleagues, new pals, and even to eat lunch. I seen that many attendees needed to sneak downstairs with their lunch plates/drinks to the resort foyer to discover a place to sit down down.
Interviews
My most important function in attending the AI {Hardware} & Edge AI Summit was to conduct numerous video interviews with representatives from these firms: Intel Labs, Nscale, MinIO, Hitachi Ventures, Ericsson, and Unilever. Every interview will floor right here on insideAI Information as an upcoming characteristic article. The entire interviewees have been superb and such good representatives for his or her respective firms. All of them exhibited huge data of their specialised subject material. I realized lots by interviewing them (and I hope you’ll too!).

The Highway Residence
I had a good time at this convention. I believe the timeliness of the {hardware} focus for AI was the largest attraction. I totally intend to do a deep dive on most of the firms I met with. I got here away with a brand new and improved perspective for the way the sphere of AI is advancing.
Ready for my flight house at San Jose Mineta Worldwide Airport (SJC), I felt like I’ll miss “The Valley” as soon as once more till my subsequent journey up north (I’m based mostly in Los Angeles). I’m by no means disillusioned with what I take with me when visiting the singular place on Earth the place a lot of AI originates.
I might extremely advocate this occasion to anybody within the AI area, or wanting to enter it. Getting a {hardware} perspective is necessary now that {hardware} is cool once more! I imagine I’ll have so as to add this occasion to my record of annual conferences for positive!
Join the free insideAI Information publication.
Be a part of us on Twitter: https://twitter.com/InsideBigData1
Be a part of us on LinkedIn: https://www.linkedin.com/firm/insideainews/
Be a part of us on Fb: https://www.fb.com/insideAINEWSNOW