Tuesday, January 17, 2023

Cambridge Massachusetts Consumer Credit Counseling Service | (800) 254-4100: Digest for January 18, 2023

Cambridge Massachusetts Consumer Credit Counseling Service | (800) 254-4100

Cambridge Massachusetts Free Consumer Credit Repair Counseling Service call (800) 254-4100, Fix Bad Credit, Increase Your Credit Score, Repair Credit Report, Remove Negative Remarks: Foreclosure, Delinquent Student Loan, Wage Garnishment, Vehicle Repossession, and Bankruptcy. Consumer credit repair counseling service provide resources to help clear your credit, increase your social credit score, solve money problems.

Boston Massachusetts Florist: Lester Van Essen Obituary (2023) - Grand Rapids, MI

by Cambridge Massachusetts Consumer Credit Counseling Service | (800) 254-4100. on Tuesday 17 January 2023 09:40 AM UTC+00 | Tags: #cambridgeconsumercreditcounselingservice cambridge-massachusetts-consumer-credit-counseling-service

Boston Massachusetts Florist

Lester Van Essen Obituary (2023) - Grand Rapids, MI

by noreply@blogger.com (Loni Cardon) on Tuesday 17 January 2023 01:35 AM UTC-05
LESTER VAN ESSEN OBITUARY. Van Essen, Rev. Lester Caledonia, MI Rev. Lester W. Van Essen, age 87, went to be with his Lord and Savior on Sunday, ...

Florist One - Send Flowers Online

January 16, 2023 at 06:00PM


Cambridge MA West Cambridge MA North Cambridge MA/ Baldwin Cambridge MA
January 17, 2023 at 02:21AM
Tags:
  • #cambridgeconsumercreditcounselingservice
  • cambridge-massachusetts-consumer-credit-counseling-service

US postal worker, 71, stabbed to death by repeat offender while walking home in Oakland, California

by Cambridge Massachusetts Consumer Credit Counseling Service | (800) 254-4100. on Tuesday 17 January 2023 11:40 AM UTC+00 | Tags: #cambridgeconsumercreditcounselingservice cambridge-massachusetts-consumer-credit-counseling-service
Dilma Spruill, 71, was walking home, as she usually does, around 12:30 a.m. after sorting mail at a post office and distribution center in West ...

virtual mailbox

January 16, 2023 at 08:42PM

Cambridge MA West Cambridge MA North Cambridge MA/ Baldwin Cambridge MA
January 17, 2023 at 04:03AM
Tags:
  • #cambridgeconsumercreditcounselingservice
  • cambridge-massachusetts-consumer-credit-counseling-service

Boston Massachusetts Florist: Obituary: Whiting, Cody Duane - WTAP

by Cambridge Massachusetts Consumer Credit Counseling Service | (800) 254-4100. on Tuesday 17 January 2023 02:41 PM UTC+00 | Tags: #cambridgeconsumercreditcounselingservice cambridge-massachusetts-consumer-credit-counseling-service

Boston Massachusetts Florist

Obituary: Whiting, Cody Duane - WTAP

by noreply@blogger.com (Loni Cardon) on Tuesday 17 January 2023 05:34 AM UTC-05
Obituary: Whiting, Cody Duane. Cody Duane Whiting Obit(none). By Phillip Hickman. Published: Jan. 16, 2023 at 8:24 AM PST|Updated: 12 hours ago.

Florist One - Send Flowers Online

January 16, 2023 at 11:33PM


Cambridge MA West Cambridge MA North Cambridge MA/ Baldwin Cambridge MA
January 17, 2023 at 07:15AM
Tags:
  • #cambridgeconsumercreditcounselingservice
  • cambridge-massachusetts-consumer-credit-counseling-service

Houston Texas Appliance Parts: Untether AI SDK Allows Bare-Metal Programming

by Cambridge Massachusetts Consumer Credit Counseling Service | (800) 254-4100. on Tuesday 17 January 2023 04:40 PM UTC+00 | Tags: #cambridgeconsumercreditcounselingservice cambridge-massachusetts-consumer-credit-counseling-service

Houston Texas Appliance Parts

Untether AI SDK Allows Bare-Metal Programming

by Houston Texas Appliance Parts on Tuesday 17 January 2023 09:22 AM UTC-05

AI accelerator chip company Untether has released a new version of its imagAIne software development kit (SDK) for the company's first-gen runAI chip, which will allow bare-metal programming for customers in fast-moving neural network applications or high performance computing (HPC).

"What really limits the adoption of [startups'] AI hardware accelerators is the software stack," said Untether's VP of product Bob Beachler in an exclusive interview with EE Times.

Bob Beachler
Bob Beachler (Source: Untether AI)

While essential to enabling the combination of optimum prediction accuracy in the application, sufficient flexibility for the desired use cases, and developer velocity, a high-quality SDK can nonetheless be a huge challenge for startups' limited resources. Untether now has more engineers on its software team than its hardware team, Beachler said.

An AI accelerator chip company's SDK is crucial to lowering applications onto hardware efficiently. It includes a compiler, which maps layer descriptions from the machine learning framework to kernels (the actual code running on the hardware), as well as physical allocation, which maps where the kernels go on the chip (plus a runtime). The SDK also provides a toolchain that allows analysis of this process.

Untether AI SDK tool flow
Untether's imAIgine SDK tool flow. (Source: Untether)

Open programming model

A key new feature of Untether's SDK is an open programming model—that is, the ability for customers to write their own kernels, analogous to writing kernels in low-level CUDA code for Nvidia GPUs, including bare-metal programming.

Custom kernels are required by applications, such AI in autonomous driving, where neural network operations evolve quickly, and HPC and scientific computing where applications outside of AI require specialized kernels for optimum efficiency.

While Untether previously offered to write kernels on customers' behalf, this service required access to their code. Beachler said that allowing customers to write their own kernels opens up specific sections of the market, including government and military applications where customers are unwilling to hand over their code. It also helps conserve Untether's resources as its customer list grows.

Why not make the open programming model available from the start?

"The bottleneck is making it interpretable for someone who hasn't lived and breathed the architecture from the very beginning," Beachler said. "That requires a certain level of maturity of the tool flow and the compiler… it took us two years to get to the point where we feel like [the SDK] is a solid enough, stable enough, and explainable enough, albeit with a training program, so that a non-Untether person can understand it and do it."

Untether's at-memory compute scheme is a spatial architecture made up of memory banks, which include small RISC processors within the banks to keep memory and compute close together. It's possible to run a single instance of each layer (for efficiency) or more than one instance of layers or sub-graphs simultaneously (for performance). Communication between kernels, however, would be different in these two scenarios. Untether now has a framework that handles kernel-to-kernel and bank-to-bank communication styles.

Untether runAI architecture
Untether's spatial architecture allows memory and compute to be kept close together. (Source: Untether AI)

With the new SDK, users can now see Untether's kernel library and modify existing kernels, or write the kernels directly from scratch (bare-metal programming). Bare-metal programmers can also perform manual kernel mapping (say which kernel connects to which, and assign them to different banks), while Untether's framework does the physical allocation and generates files to send to the runtime. While kernel creation requires knowledge of Untether's proprietary RISC processors inside the banks and its custom instructions, those familiar with low-level programming shouldn't find this a challenge, Beachler said.

"This allows [users] to really be their own boss," he said. "They never need to talk to us. They can go ahead and make obscure layers, make obscure kernels, and be able to integrate it into the compiler so that they can go ahead and move forward."

Separate AI tool flows in Untether's SDK for neural networks and HPC users
The result is two tool flows—one for neural network users and one for HPC/custom kernel users (click to enlarge) (Source: Untether)

Accuracy

Aside from custom kernels, prediction accuracy is high on the list of customer demands, Beachler added. Quantizing to runAI's INT8 or INT16 formats while maintaining accuracy is something Untether is focusing on; the latest version of the company's SDK can handle post-quantization retraining, if required. This can include classic retraining, or a technique called knowledge distillation (which involves a student-teacher relationship between the original and the quantized model).

Untether's poster session at NeurIPS was also about quantization—specifically, about quantizing transformer networks to INT8. Transformers present particular problems for quantization because their iterative nature means errors accumulate and propagate. Natural language processing inference applications are therefore extremely sensitive to accuracy. Combining Untether's quantization methods with a new proprietary technique where activation functions are implemented via a lookup table can help ensure accuracy in these types of models, Beachler said, adding that function also relies on good kernel design.

Next-gen architecture

The ability to write custom kernels will carry over to Untether's second-gen chip, speedAI, when it becomes available in the second half of 2023.

"The only difference between runAI and speedAI in the SDK tool flow is the low-level kernel code, which is slightly different," Beachler said. "It is recompiled for the RISC-V ISA on speedAI and optimized for speedAI's dual RISC-V memory banks."

While runAI kernels will need to be recompiled to work on speedAI, designers' knowledge of kernel development for runAI will carry over to speedAI without any problems, he said.

The post Untether AI SDK Allows Bare-Metal Programming appeared first on EE Times.


Appliance Parts
January 17, 2023 at 09:00AM


Cambridge MA West Cambridge MA North Cambridge MA/ Baldwin Cambridge MA
January 17, 2023 at 09:46AM
Tags:
  • #cambridgeconsumercreditcounselingservice
  • cambridge-massachusetts-consumer-credit-counseling-service
You received this email because you set up a subscription at Feedrabbit. This email was sent to you at fria9uyq@lenapaisa.anonaddy.me. Unsubscribe or change your subscription.

No comments:

Post a Comment

Note: Only a member of this blog may post a comment.