PaSh: Light-touch Data-Parallel Shell Scripting
Overview PaSh aims at the correct and automated parallelization of POSIX shell scripts. Broadly, PaSh includes three components: (1) a compiler that, given as input a POSIX shell script, emits a POSIX shell script that includes explicit data-parallel fragments for which PaSh has deemed such parallelization semantics-preserving, (2) a set of PaSh-related runtime primitives for supporting the execut
Measuring the memory-level parallelism of a system using a small C++ program? – Daniel Lemire's blog
S3 Select and Glacier Select – Retrieving Subsets of Objects | Amazon Web Services
AWS News Blog S3 Select and Glacier Select – Retrieving Subsets of Objects Amazon Simple Storage Service (Amazon S3) stores data for millions of applications used by market leaders in every industry. Many of these customers also use Amazon Glacier for secure, durable, and extremely low-cost archival storage. With S3, I can store as many objects as I want and individual objects can be as large as 5
djbsort: Intro
djbsort is a new software library for sorting arrays of integers or floating-point numbers. It provides the following features: Speed: djbsort holds new speed records for in-memory sorting. Security: djbsort is designed to be safe for cryptographic contexts. Verification: djbsort includes tools to automatically verify correctness. These features are not separate options: there is a single sorting
SSSE3: fast popcount
2016-03-16 (detailed results from Westmere, Haswell & Skylake), 2016-03-13 (AVX2 implementation, results from Westmere and Skylake, wording), 2015-03-04 (link to github repo), 2011-10-22 (link to paper, unrolled loops), 2010-06-28 (link to Peter's site), 2010-03-27 (SSE2 procedures), Introduction Population count is a procedure of counting number of ones in a bit string. Intel introduced instructi
SYCL - C++ Single-source Heterogeneous Programming for Acceleration Offload
SYCL (pronounced ‘sickle’) is a royalty-free, cross-platform abstraction layer that: Enables code for heterogeneous and offload processors to be written using modern ISO C++ (at least C++ 17). Provides APIs and abstractions to find devices (e.g. CPUs, GPUs, FPGAs) on which code can be executed, and to manage data resources and code execution on those devices. SYCL defines abstractions to enable he
Super Fast Builds Using distcc | PSPDFKit
Preparation First, let me draw your attention to ccache. We’ve had a lot of success using ccache, which we wrote about before in Using Ccache for Fun and Profit. I highly recommend you read that blog post first, as this post is written with the assumption you have ccache set up as described in that blog post. It’s absolutely possible to use distcc without ccache if you really need to, but we would
Bitonic sorter - Wikipedia
Bitonic mergesort is a parallel algorithm for sorting. It is also used as a construction method for building a sorting network. The algorithm was devised by Ken Batcher. The resulting sorting networks consist of comparators and have a delay of , where is the number of items to be sorted.[1] This makes it a popular choice for sorting large numbers of elements on an architecture which itself contain
Extremely Large Minibatch SGD: Training ResNet-50 on ImageNet in 15 Minutes
We demonstrate that training ResNet-50 on ImageNet for 90 epochs can be achieved in 15 minutes with 1024 Tesla P100 GPUs. This was made possible by using a large minibatch size of 32k. To maintain accuracy with this large minibatch size, we employed several techniques such as RMSprop warm-up, batch normalization without moving averages, and a slow-start learning rate schedule. This paper also desc
リリース、障害情報などのサービスのお知らせ
最新の人気エントリーの配信
j次のブックマーク
k前のブックマーク
lあとで読む
eコメント一覧を開く
oページを開く
GitHub - deeptir18/posh: Data-Aware Shell
GitHub - nv-legate/cunumeric: An Aspiring Drop-In Replacement for NumPy at Scale
GitHub - thrill/thrill: Thrill - An EXPERIMENTAL Algorithmic Distributed Big Data Batch Processing Framework in C++
GitHub - grailbio/bigslice: A serverless cluster computing system for the Go programming language
GitHub - pdlfs/deltafs: Transient file system service featuring highly paralleled indexing on both file data and file system metadata
alpha new (Archived)
Speed up Sort in Peloton using AVX2 by xhad1234
Batcher odd–even mergesort - Wikipedia
padal-workshop
GitHub - kokkos/kokkos: Kokkos C++ Performance Portability Programming Ecosystem: The Programming Model - Parallel Execution and Memory Abstraction
GitHub - oneapi-src/oneDPL: oneAPI DPC++ Library (oneDPL) https://software.intel.com/content/www/us/en/develop/tools/oneapi/components/dpc-library.html
