Oleg Zabluda's blog
Wednesday, March 01, 2017
 
DeepVoice: Real-time Neural Text-to-Speech (2017) Sercan O. Arik, Mike Chrzanowski, Adam Coates, Gregory Diamos [...]
DeepVoice: Real-time Neural Text-to-Speech (2017) Sercan O. Arik, Mike Chrzanowski, Adam Coates, Gregory Diamos [...]
"""
On CPU, a single Haswell or Broadwell core has a peak single-precision throughput of approximately 77 × 10^9 FLOPs and an L2-to-L1 cache bandwidth of approximately 140GB/s. The model must be loaded from cache once per timestep, which requires a bandwidth of 100 GB/s. Even if the model were to fit in L2 cache, the implementation would need to utilize 70% of the maximum bandwidth and 70% of the peak FLOPS in order to do inference in realtime on a single core. Splitting the calculations across multiple cores reduces the difficulty of the problem, but nonetheless it remains challenging as inference must operate at a significant fraction of maximum memory bandwidth and peak FLOPs and while keeping threads synchronized.

A GPU has higher memory bandwidth and peak FLOPs than a CPU but provides a more specialized and hence restrictive computational model. A naive implementation that launches a single kernel for every layer or timestep is untenable, but an implementation based on the persistent RNN technique (Diamos et al., 2016) may be able to take advantage of the throughput offered by GPUs.

We implement high-speed optimized inference kernels for both CPU and GPU and demonstrate that WaveNet inference at faster-than-real-time speeds is achievable. Table 2 lists the CPU and GPU inference speeds for different models. In both cases, the benchmarks include only the autoregressive, high-frequency audio generation and do not include the generation of linguistic conditioning features which can be done in parallel for the entire utterance). Our CPU kernels run at real-time or faster-than-real-time for a subset of models, while the GPU models do not yet match this performance.
"""
https://arxiv.org/abs/1702.07825

https://arxiv.org/abs/1702.07825

Labels:


- posted by Oleg Zabluda @ 11:28 PM | permalink | | | technorati | bloglines | feedster
 
NVIDIA GPU / Compare
NVIDIA GPU / Compare
https://docs.google.com/spreadsheets/d/1xAo6TcSgHdd25EdQ-6GqM0VKbTYu8cWyycgJhHRVIgY/

benchmark, performance, speed, power, Deep Learning

Labels:


- posted by Oleg Zabluda @ 11:14 PM | permalink | | | technorati | bloglines | feedster
 
The Ross Sisters - Solid Potato Salad
The Ross Sisters - Solid Potato Salad
"""
This is the full length video, "From The Top", excellent quality, please enjoy! This video has been color enhanced!

The original movie is Broadway Rhythm (1944) additional information may be found at;

http://en.wikipedia.org/wiki/Broadway_Rhythm
IMDb: http://www.imdb.com/title/tt0036673/

Amazon (DVD): http://www.amazon.com/Broadway-Rhythm-George-Murphy/dp/B002GOJYSC

# The Ross Sisters - Wikipedia: http://en.wikipedia.org/wiki/Ross_Sisters

**NOTE: "Solid" is a 1940's Slang term for "1st Rate", "The Best", etc.
"""
https://www.youtube.com/watch?v=d1J3NLNWAPU&t=2m25s
https://www.youtube.com/watch?v=d1J3NLNWAPU&t=2m25s

Labels:


- posted by Oleg Zabluda @ 10:52 PM | permalink | | | technorati | bloglines | feedster
 
Amazon Glacier storage speculations (see first comment). HDD, Tape, Blu-Ray optical.
Amazon Glacier storage speculations (see first comment). HDD, Tape, Blu-Ray optical.
https://storagemojo.com/2014/04/25/amazons-glacier-secret-bdxl/
https://storagemojo.com/2014/04/25/amazons-glacier-secret-bdxl/

Labels:


- posted by Oleg Zabluda @ 5:57 PM | permalink | | | technorati | bloglines | feedster
 
Titan missile

https://goo.gl/photos/bv2RNyfvKRqK8LYG8

Labels:


- posted by Oleg Zabluda @ 3:09 PM | permalink | | | technorati | bloglines | feedster

Powered by Blogger