Christopher Olston - Publications
Papers by Christopher Olston Research community reports Machine learning Enterprise data management Continuous data processing workflows Data pipeline programming & debugging Large-scale data processing Web monitoring & crawling Web search Web application scalability Distributed data monitoring Data visualization Research community reports Numerous co-authors. The Beckman Report on Database Resear
Sessionization in SQL, Hive, Pig and Python — Dataiku Academy 7.0 documentation
Why sessionization?¶ Sessionization is the act of turning event-based data into sessions, the ordered list of a user’s actions in completing a task. It is widely used in several domains, such as: Web analytics. This is the most common use, where a session is composed of a user’s actions during one particular visit to the website. You can think of this as a buying session on a e-business website fo
Introducing Surus and ScorePMML
Today we’re announcing a new Netflix-OSS project called Surus. Over the next year we plan to release a handful of our internal user defined functions (UDF’s) that have broad adoption across Netflix. The use cases for these functions are varied in nature (e.g. scoring predictive models, outlier detection, pattern matching, etc.) and together extend the analytical capabilities of big data. The first
Using Avro in MapReduce jobs with Hadoop, Pig, Hive
Apache Avro is a very popular data serialization format in the Hadoop technology stack. In this article I show code examples of MapReduce jobs in Java, Hadoop Streaming, Pig and Hive that read and/or write data in Avro format. We will use a small, Twitter-like data set as input for our example MapReduce jobs. Requirements Prerequisites Example data Avro schema Avro data files Preparing the input d
Cloudera Blog
Enterprises see embracing AI as a strategic imperative that will enable them to stay relevant in increasingly competitive markets. However, it remains difficult to quickly build these capabilities given the challenges with finding readily available talent and resources to get started rapidly on the AI journey. Cloudera recently signed a strategic collaboration agreement with Amazon […] Read blog p
PayPal Behavioral Analytics on Hadoop
Thomas Wolf "An Introduction to Transfer Learning and Hugging Face"Fwdays
[PIG-2167] CUBE operation in Pig - ASF JIRA
Computing aggregates over a cube of several dimensions is a common operation in data warehousing. The standard SQL syntax is "GROUP relation BY dim1, dim2, dim3 WITH CUBE" – which in addition to all dim1-2-3, produces aggregations for just dim1, just dim1 and dim2, etc. NULL is generally used to represent "all". A presentation by Arnab Nandi describes how one might implement efficient cubing in Ma
Cloudera Blog
Enterprises see embracing AI as a strategic imperative that will enable them to stay relevant in increasingly competitive markets. However, it remains difficult to quickly build these capabilities given the challenges with finding readily available talent and resources to get started rapidly on the AI journey. Cloudera recently signed a strategic collaboration agreement with Amazon […] Read blog p
リリース、障害情報などのサービスのお知らせ
最新の人気エントリーの配信
j次のブックマーク
k前のブックマーク
lあとで読む
eコメント一覧を開く
oページを開く
ASF JIRA
データ活用を効率化するHadoop WebUIと権限管理改善事例
GitHub - Netflix/Surus
GitHub - miguno/avro-hadoop-starter: Example MapReduce jobs in Java, Hive, Pig, and Hadoop Streaming that work on Avro data.
Cloudera Blog
Automated install of CDH5 Hadoop on your laptop with Ansible
February 2014 HUG : Pig On Tez
13 Things You Didn’t Know You Could Do with Pig | Mortar Blog | Data Science at Scale
Bits and pieces
https://media.blackhat.com/us-13/US-13-Hanif-Binarypig-Scalable-Malware-Analytics-in-Hadoop-Slides.pdf
BH Whitepaper.docx
Setting up spork with spark 0.8.1 - Apache Spark Documentation