GitHub - onceupon/Bash-Oneliner: A collection of handy Bash One-Liners and terminal tricks for data processing and Linux system maintenance.
I am glad that you are here! I was working on bioinformatics a few years ago and was amazed by those single-word bash commands which are much faster than my dull scripts, time saved through learning command-line shortcuts and scripting. Recent years I am working on cloud computing and I keep recording those useful commands here. Not all of them is oneliner, but i put effort on making them brief an
こんにちは．株式会社ゆめみの Keeth こと桑原です．Twitter には #つぶやきProcessing という魅力的なタグがあり，毎日数々の美しい作品がこのタグを付けて投稿されています．これを眺めるだけでも一日中過ごせるくらいです（個人の感覚です）． 今日はその中でも特に度肝を抜かれ，かつ感動した作品が 2022/11/04 に投稿されておりましたので，個人の拙い能力で解析に挑戦してみました💁 ※一部解析しきれていない部分がありますが，ご容赦いただけますと幸いです…何分勉強中の者でして… 作品 なにはともあれ今回対象の作品． 初めてみたときは思わず言葉を失いました．いや，これ twitter のツイートですのでかなり文字数も少ないんですよ！なのにこの表現ってどうなってんの！？と… これはかなり学びになると思い解析を試みようと思い立った次第です．それにしても美しい… ソースコード で
This article was discussed on Hacker News. I recently learned of csvquote, a tool that encodes troublesome CSV characters such that unix tools can correctly process them. It reverses the encoding at the end of the pipeline, recovering the original input. The original implementation handles CSV quotes using the straightforward, naive method. However, there’s a better approach that is not only simpl
序 この記事では、次のような一つの簡単なProcessingスケッチについて、様々なスタイルでコードを書いて比較してみます。 float[][][]d=new float[32][2][2]; float f(float[]x){return x[0]+=((frameCount%30==0?x[1]=random(100):x[1])-x[0])/4;} void setup(){size(800,800);fill(252,32);} void draw(){ square(0,0,800); scale(8); for(float[][]e:d) line(e[0][0],e[1][0],f(e[0]),f(e[1])); }#つぶやきProcessing pic.twitter.com/055DFzHmwF — FAL @STG制作とプログラミングお絵かき (@falworks_j
GitHub - Overv/outrun: Execute a local command using the processing power of another Linux machine.
You signed in with another tab or window. Reload to refresh your session. You signed out in another tab or window. Reload to refresh your session. You switched accounts on another tab or window. Reload to refresh your session. Dismiss alert
ノードエディタ形式の画像処理ツール「Image-Processing-Node-Editor」 - Qiita
はじめに 趣味でノードエディタ形式の画像処理ツール「Image-Processing-Node-Editor」を作りました。 その紹介の記事です。中身にOpenCVガッツリ使っているからアドカレOKですよね。。。👀？ ガッツリ使っているという意味では、GUI部分の DearPyGui のほうがガッツリ使っているかもしれませんが🤔 「Image-Processing-Node-Editor」とは 以下のように、ノードを接続していくことで、処理結果を可視化しながら画像処理が行えるツールです。 以下のような特徴があります。 主要な処理は全てPython ※ライブラリ部分除く 各処理を可視化しながら画像処理が試せる 自作ノードの追加が容易 (だと信じている) 記事書くために見直していましたが、イマイチ複雑ですわ、、、😇 OSS (Apache 2.0ライセンス) デフォルトでいくつかのAI機
自作パケット処理系の性能測定と可視化&改善のPDCAを回して最強のパケット処理系の作り方を学ぼう / Let's Measure the Performance of Packet Processing System with Python Tools.
Pycon APAC 2023で登壇した時の資料です。 https://pretalx.com/pyconapac2023/talk/G3LDSG/ https://2023-apac.pycon.jp/timetable?id=G3LDSG
Ruby で Processing がブラウザ上からできる p5.rb を作りました - ブログのおんがえし
ruby.wasm + p5.js の組み合わせです。ほとんどの API は移植したので大体同じことができると思います。 https://p5rb.ongaeshi.me/ https://p5rb.ongaeshi.me/examples に色々サンプル。 https://p5rb.ongaeshi.me/editor にオンラインエディタがあります。 使い方 p5.rb を HTML に読みこめばすぐに使えます。 <html> <head> <script src="https://cdn.jsdelivr.net/npm/ruby-3_2-wasm-wasi@next/dist/browser.script.iife.js"></script> <script src="https://cdn.jsdelivr.net/npm/p5@1.5.0/lib/p5.js"></script
Photon: A high-performance WebAssembly image processing library.
Image Processing in WebAssembly Photon is a high-performance image processing library in WebAssembly that runs both natively and on the web. Features Photon outperforms even the fastest of libraries, and is powered with Rust, allowing for safe and secure image processing. Web-Assembly Friendly For web-based image processing, Photon is 4-10x faster than JS, leading to faster results, and less lag.
Stanford CS 224N | Natural Language Processing with Deep Learning
Logistics Lectures: are on Tuesday/Thursday 4:30 PM - 5:50 PM Pacific Time in NVIDIA Auditorium. In-person lectures will start with the first lecture. The Zoom link is posted on Canvas. Lecture videos for enrolled students: are posted on Canvas (requires login) shortly after each lecture ends. Unfortunately, it is not possible to make these videos viewable by non-enrolled students. Publicly availa
Engineers solve 50-year-old puzzle in signal processing by Mike Krapfl, Iowa State University Vladimir Sukhoy and Alexander Stoytchev, left to right, with the derivation for the ICZT algorithm in structured matrix notation -- the answer to a 50-year-old puzzle in signal processing. Credit: Paul Easker Something called the fast Fourier transform is running on your cell phone right now. The FFT, as
GitHub - nlp-with-transformers/notebooks: Jupyter notebooks for the Natural Language Processing with Transformers book
You signed in with another tab or window. Reload to refresh your session. You signed out in another tab or window. Reload to refresh your session. You switched accounts on another tab or window. Reload to refresh your session. Dismiss alert
Trends in Natural Language Processing at NeurIPS 2019.
[CV関東3D勉強会] TPVFormer ~マルチカメラを用いた自動運転の3D Occupancy Prediction~
On the Way to Democratized Stream Processing: RisingWave’s Roadmap - RisingWave: Open-Source Streaming Database
Two months ago, we open-sourced RisingWave, a cloud-native streaming database. RisingWave is developed on the mission to democratize stream processing — to make stream processing simple, affordable, and accessible. You may check out our recent blog, document, and source code for more information about RisingWave. Rome was not built in a day, and neither are database systems. We started developing
GitHub - facebookresearch/audiocraft: Audiocraft is a library for audio processing and generation with deep learning. It features the state-of-the-art EnCodec audio compressor / tokenizer, along with MusicGen, a simple and controllable music generation LM
You signed in with another tab or window. Reload to refresh your session. You signed out in another tab or window. Reload to refresh your session. You switched accounts on another tab or window. Reload to refresh your session. Dismiss alert
インテル、新デバイス「Infrastructure Processing Unit」（IPU）発表。スマートNICを拡張しストレージ仮想化やネットワーク仮想化処理などCPUからオフロード可能に
インテル、新デバイス「Infrastructure Processing Unit」（IPU）発表。スマートNICを拡張しストレージ仮想化やネットワーク仮想化処理などCPUからオフロード可能に インテルは、クラウド事業者や通信サービス事業者向けに、インフラストラクチャー・プロセシング・ユニット（IPU）を発表しました（インテルジャパンの発表）。 Introducing the Infrastructure Processing Unit. https://t.co/qro7AYYA9o #SixFiveSummit pic.twitter.com/LY9e6G7Yn2 — Intel News (@intelnews) June 14, 2021 IPUは、ネットワークカードをインテリジェントにしたスマートNICをさらに拡張したもの。これまでCPUで行われていたストレージ仮想化処理やネット
Step Functions Distributed Map – A Serverless Solution for Large-Scale Parallel Data Processing | Amazon Web Services
AWS News Blog Step Functions Distributed Map – A Serverless Solution for Large-Scale Parallel Data Processing I am excited to announce the availability of a distributed map for AWS Step Functions. This flow extends support for orchestrating large-scale parallel workloads such as the on-demand processing of semi-structured data. Step Function’s map state executes the same processing steps for multi
社内勉強会「【DP(Data Processing)⇔システム】Pythonについて話そう！会」参加レポート - GMO RESEARCH Tech Blog
社内勉強会「【DP(Data Processing)⇔システム】Pythonについて話そう！会」参加レポート 2020.06.05 技術 社内勉強会, GMOインターネット, python こんにちは。 GMOリサーチ株式会社の向井と申します。 システム部でプログラマーをしています。 また、売上向上/経費削減のために、社内の他部署での作業の効率化もおこなっています。 今日は、弊社GMOリサーチで開催されたオンライン社内勉強会、「【DP⇔システム】Pythonについて話そう！会」の参加レポートをお送りします。 現在、コロナ禍で在宅勤務をしている関係でオンラインでの勉強会となりました。 情報共有は、オンラインチャットツールであるchatworkにて。 ビデオ通話ソフトはGoogle Meetを使いました。 イベント内容について 「【DP⇔システム】Pythonについて話そう！会」がどんな会だっ
eBPF and XDP for Processing Packets at Bare-metal Speed - Sematext
XDP or Express Data Path arises due to the pressing need for high-performance packet processing in the Linux kernel. Several kernel bypass techniques (DPDK being the most prominent one) aim to accelerate network operations by moving packet processing to user space. This means ditching the overhead induced by context switches, syscall transitions or IRQ requests between the kernel-user space bounda
Purl is a command-line utility designed for text file parsing and manipulation, offering a modern alternative to traditional sed and perl one-liners. It features intuitive options for filtering, transforming, and managing text data. Importantly, Purl accepts both file input and standard input, providing flexibility for various workflows. Moreover, it supports multiple instances of the -filter and
An in-depth look at Google’s first Tensor Processing Unit (TPU) | Google Cloud Blog
There’s a common thread that connects Google services such as Google Search, Street View, Google Photos and Google Translate: they all use Google’s Tensor Processing Unit, or TPU, to accelerate their neural network computations behind the scenes. We announced the TPU last year and recently followed up with a detailed study of its performance and architecture. In short, we found that the TPU delive
Edge-orientation processing in first-order tactile neurons - Nature Neuroscience
Thank you for visiting nature.com. You are using a browser version with limited support for CSS. To obtain the best experience, we recommend you use a more up to date browser (or turn off compatibility mode in Internet Explorer). In the meantime, to ensure continued support, we are displaying the site without styles and JavaScript.
みなさんこんにちは。機械学習チームのたかぱい（@takapy0210）です。 2021年もあと1ヶ月となりましたね。皆様いかがお過ごしでしょうか。 ...さて12月といえば、毎年恒例のアドベントカレンダーの季節ですね！ というわけで、2021年もコネヒト Advent Calendarが始まります！🎉 初日となる本エントリでは、機械学習チームで使用しているSageMaker*1の機能である、Processing*2について、活用事例とともにご紹介しようと思います。 目次 SageMaker Processingとは? SKLearnProcessor / PySparkProcessor Processor / ScriptProcessor これまでの課題感 SageMaker Processorの活用方法 SageMakerからECRにあるコンテナを指定してProcessor Job
(PDF) Edge-orientation processing in first-order tactile neurons
A fundamental feature of first-order neurons in the tactile system is that their distal axon branches in the skin and forms many transduction sites, yielding complex receptive fields with many highly sensitive zones. We found that this arrangement constitutes a peripheral neural mechanism that allows individual neurons to signal geometric features of touched objects. Specifically, we observed that
Google Cloud、インテルと共同開発したASIC「Infrastructure Processing Unit（IPU）」採用を発表。FPGAベースのSoCでサーバ本体の処理をオフロード
Google Cloud、インテルと共同開発したASIC「Infrastructure Processing Unit（IPU）」採用を発表。FPGAベースのSoCでサーバ本体の処理をオフロード Google Cloudとインテルは、両社が共同開発したクラウド基盤用のASIC「Intel Infrastructure Processing Unit」（Intel IPU）のGoogle Cloudでの採用を明らかにしました。 Data center infrastructure that is more secure, flexible and performant.@GoogleCloud C3 VM is first to feature custom Intel IPUs and 4th Gen Intel #XeonScalable processors in private pr
New General Purpose, Compute Optimized, and Memory-Optimized Amazon EC2 Instances with Higher Packet-Processing Performance | Amazon Web Services
The r6in and r6idn instances are available in the US East (Ohio, N. Virginia), US West (Oregon), and Europe (Ireland) regions in On-Demand and Spot form. Savings Plans and Reserved Instances are available. Inside the Instances As you can probably guess from these specs and from the blog post that I wrote to launch the c6in instances, all of these new instance types have a lot in common. I’ll do a
GitHub - binpash/pash: PaSh: Light-touch Data-Parallel Shell Processing
You signed in with another tab or window. Reload to refresh your session. You signed out in another tab or window. Reload to refresh your session. You switched accounts on another tab or window. Reload to refresh your session. Dismiss alert
GitHub - xavctn/img2table: img2table is a table identification and extraction Python Library for PDF and images, based on OpenCV image processing
You signed in with another tab or window. Reload to refresh your session. You signed out in another tab or window. Reload to refresh your session. You switched accounts on another tab or window. Reload to refresh your session. Dismiss alert
A perceptual color space for image processing A perceptual color space is desirable when doing many kinds of image processing. It is useful for things like: Turning an image grayscale, while keeping the perceived lightness the same Increasing the saturation of colors, while maintaining perceived hue and lightness Creating smooth and uniform looking transitions between colors Unfortunately, as far
Video processing with WebCodecs | Web Platform | Chrome for Developers
Modern web technologies provide ample ways to work with video. Media Stream API, Media Recording API, Media Source API, and WebRTC API add up to a rich tool set for recording, transferring, and playing video streams. While solving certain high-level tasks, these APIs don't let web programmers work with individual components of a video stream such as frames and unmuxed chunks of encoded video or au
Processing large JSON files in Python without running out of memory
Processing large JSON files in Python without running out of memory by Itamar Turner-Trauring Last updated 06 Jan 2023, originally created 14 Mar 2022 If you need to process a large JSON file in Python, it’s very easy to run out of memory. Even if the raw data fits in memory, the Python representation can increase memory usage even more. And that means either slow processing, as your program swaps
GitHub - javascriptdata/danfojs: Danfo.js is an open source, JavaScript library providing high performance, intuitive, and easy to use data structures for manipulating and processing structured data.
Danfo.js is fast and supports Tensorflow.js tensors out of the box. This means you can convert Danfo data structure to Tensors. Easy handling of missing-data (represented as NaN) in floating point as well as non-floating point data Size mutability: columns can be inserted/deleted from DataFrame Automatic and explicit alignment: objects can be explicitly aligned to a set of labels, or the user can
Index Compression Using Byte-Aligned ANS Coding and Two-Dimensional Contexts
GitHub - MTG/essentia.js: JavaScript library for music/audio analysis and processing powered by Essentia WebAssembly
Essentia.js is a JavaScript (JS) library for music/audio signal analysis and processing developed at the Music Technology Group, UPF, Barcelona. The core of library is powered by Essentia C++ library back-end using WebAssembly built via Emscripten along with a high-level JS and TypeScript API and add-on utility modules. ie, You can run an extensive collection of music/audio processing and analysis
週刊Railsウォッチ（20201116前編）6.1のActive Storageでimage_processing gemが必須に、Webアプリ設計の変遷とフロントエンド領域の再定義ほか｜TechRacho by BPS株式会社
2020.11.16 週刊Railsウォッチ（20201116前編）6.1のActive Storageでimage_processing gemが必須に、Webアプリ設計の変遷とフロントエンド領域の再定義ほか こんにちは、hachi8833です。 各記事冒頭には⚓でパーマリンクを置いてあります: 社内やTwitterでの議論などにどうぞ 「つっつきボイス」はRailsウォッチ公開前ドラフトを（鍋のように）社内有志でつっついたときの会話の再構成です👄 お気づきの点がありましたら@hachi8833までメンションをいただければ確認・対応いたします🙇 ⚓Rails: 先週の改修（Rails公式ニュースより） 以下のコミットリストのChangelogを中心に見繕いました。ドキュメントの更新が増えているようです。 コミットリスト: Comparing @{2020-11-05}...maste
Background Preventatives measures to combat the spread of COVID− 19 have introduced social isolation, loneliness and financial stress. This study aims to identify whether the COVID-19 pandemic is related to changes in suicide-related problems for help seekers on a suicide prevention helpline. Methods A retrospective cohort study was conducted using chat data from a suicide prevention helpline in t
Trends in Natural Language Processing: ACL 2019 In Review - Mihail Eric
This week I had the great fortune to attend the Annual Meeting of the Association for Computational Linguistics (ACL) 2019 held in wonderful Florence in an old Medici family fortress. Conferences are some of my favorite events to attend because in a very short amount of time you are able to tap into the stream-of-consciousness of a community, to learn what people are thinking and where the field i
Apache AGE, Graph database optimized for fast analysis and real-time data processing. It is provided as an extension to PostgreSQL.
Apache AGE Graph Database for PostgreSQL Apache AGE is a PostgreSQL Graph database compatible with PostgreSQL's distributed assets and leverages graph data structures to analyze and use relationships and patterns in data. Get Started with Apache AGE Download Apache AGE Apache AGE® is a PostgreSQL that provides graph database functionality. The goal of Apache AGE® is to provide graph data processin
GitHub - yuanqing/vdx: :film_strip: An intuitive CLI for processing video, powered by FFmpeg
You signed in with another tab or window. Reload to refresh your session. You signed out in another tab or window. Reload to refresh your session. You switched accounts on another tab or window. Reload to refresh your session. Dismiss alert
What Every Software Engineer Should Know about Apache Kafka: Events, Streams, Tables, Storage, Processing, And More
To help fellow engineers wrap their head around Apache Kafka and event streaming, I wrote a 4-part series on the Confluent blog on Kafka’s core fundamentals. In the series, we explore Kafka’s storage and processing layers and how they interrelate, featuring Kafka Streams and ksqlDB. In the first part, I begin with an overview of events, streams, tables, and the stream-table duality to set the stag
j次のブックマーク
k前のブックマーク
lあとで読む
eコメント一覧を開く
oページを開く
私が感動した Processing 製の作品のソースコードを解析してみた
Fast CSV processing with SIMD
Processingで見るプログラミングスタイル七変化 - Qiita
Engineers solve 50-year-old puzzle in signal processing
GitHub - catatsuy/purl: Streamlining Text Processing
機械学習プロジェクトにおけるSageMaker Processingの使い所 - コネヒト開発者ブログ
A perceptual color space for image processing
Understanding distributed processing in Python
(PDF) Natural Language Processing with Python