| Description |
1 online resource : illustrations |
| Note |
"Dataflow scripting with Hadoop"--Cover. |
|
Includes index. |
| Summary |
For many organizations, Hadoop is the first step for dealing with massive amounts of data. The next step? Processing and analyzing datasets with the Apache Pig scripting platform. With Pig, you can batch-process data without having to create a full-fledged application, making it easy to experiment with new datasets. Updated with use cases and programming examples, this second edition is the ideal learning tool for new and experienced users alike. You'll find comprehensive coverage on key features such as the Pig Latin scripting language and the Grunt shell. When you need to analyze terabytes of data, this book shows you how to do it efficiently with Pig. Delve into Pig's data model, including scalar and complex data typesWrite Pig Latin scripts to sort, group, join, project, and filter your dataUse Grunt to work with the Hadoop Distributed File System (HDFS)Build complex data processing pipelines with Pig's macros and modularity featuresEmbed Pig Latin in Python for iterative processing and other advanced tasksUse Pig with Apache Tez to build high-performance batch and interactive data processing applicationsCreate your own load and store functions to handle data formats and storage mechanisms. |
| Contents |
1. What is Pig? -- 2. Installing and running Pig -- 3. Pig's data model -- 4. Introduction to Pig Latin -- 5. Advanced Pig Latin -- 6. Developing and testing Pig Latin scripts -- 7. Making Pig fly -- 8. Embedding Pig -- 9. Writing evaluation and filter functions -- 10. Writing load and store functions -- 11. Pig on Tez -- 12. Pig and other members of the Hadoop community -- 13. Use cases and programming examples. |
| Subject |
Apache Pig (Computer file)
|
|
Programming languages (Electronic computers) -- Handbooks, manuals, etc.
|
|
Open source software.
|
|
Pig Latin (Computer program language)
|
|
Logiciels libres. |
|
Open source software |
|
Programming languages (Electronic computers) |
| Genre |
Handbook |
|
handbooks.
|
|
Handbooks and manuals
|
|
Handbooks and manuals.
|
|
Guides et manuels.
|
| Added Author |
Dai, Daniel, author.
|
| Other Form: |
Print version: Gates, Alan. Programming Pig. Second edition. Sebastopol, CA : O'Reilly Media, Inc., 2016 9781491937099 (OCoLC)926743778 |
| ISBN |
9781491937068 (electronic bk.) |
|
1491937068 (electronic bk.) |
|
9781491937044 (electronic bk.) |
|
1491937041 (electronic bk.) |
|
(paperback) |
|
(paperback) |
|
More Resources