_making-pyspark-amazingfrom-faster-udfs-to-dependency-management-and-graphing-holden-karau-google-and-bryan-cutler-ibm.jpg "Making PySpark Amazing—From Faster UDFs to Dependency Management and Graphing! Holden Karau (Google) and Bryan Cutler (IBM) from pandas numpy Video Screenshot Preview")
GalleryPlay Video:
(Note: The default playback of the video is HD VERSION. If your browser is buffering the video slowly, please play the REGULAR MP4 VERSION or Open The Video below for better experience. Thank you!)
⏲ Duration: 18 min 50 sec
✓ Published: 11-Jun-2018
✓ Published: 11-Jun-2018
Description:
PySpark is getting awesomer in Spark 2.3 with vectorized UDFs, and there is even more wonderful things on the horizon (and currently available as WIP packages). This talk will start by illustrating how to use PySpark’s new vectorized UDFs to make ML pipeline stages. Since most of us use Python in part because of its wonderful libraries, like pandas, numpy, and antigravity*, it’s important to be able to make sure that our dependencies are available on our cluster. Historically there’s been
PySpark is getting awesomer in Spark 2.3 with vectorized UDFs, and there is even more wonderful things on the horizon (and currently available as WIP packages). This talk will start by illustrating how to use PySpark’s new vectorized UDFs to make ML pipeline stages. Since most of us use Python in part because of its wonderful libraries, like pandas, numpy, and antigravity*, it’s important to be able to make sure that our dependencies are available on our cluster. Historically there’s been
Share with your friends:
Whatsapp | Viber | Telegram | Line | SMS
Email | Twitter | Reddit | Tumblr | Pinterest
Related Videos
_numpy-and-pandas-tutorial-124-data-analysis-with-python-124-python-tutorial-for-beginners-124-simplilearn.webp "Simplilearn")
⏲ 2 hours 14 minutes 29 seconds 👁 42.4K
_glafc-gla-1-stream-labs-python-for-data-analytics-numpy-and-pandas-18-dec-friday-715-815.webp "Attendance & Feedback form- https://forms.gle/cLKNDrS6Ty78yXfR6")
⏲ 49 min 28 sec ✓ 11-Dec-2020
_data-analysis-with-python-full-course-for-beginners-numpy-pandas-matplotlib-seaborn.webp "freeCodeCamp.org")
⏲ 4 hours 22 minutes 13 seconds 👁 1.6M
_data-analysis-with-python-course-numpy-pandas-data-visualization.webp "freeCodeCamp.org")
⏲ 9 hours 56 minutes 23 seconds 👁 1.3M
_python-101-learn-the-5-must-know-concepts.webp "Tech With Tim")
_numpy-vs-scipy.webp "IBM Technology")
_demo-data-science-master-training-trainer-kumar.webp "For More Info: Please visit, zarantech.com/data-science-master-program/nContact: +1 (515) 309-7846 (or) Email - info@zarantech.comn==========================================nCourse Duration:100 hours Live Training + Assignments + Actual Project Based Case Studiesn===========================================nMODULES COVERED IN THIS TRAINING:nnUnit 1: Programming in python and r:nnBelow topics are covered in this Python essentials module for Data Science.nPython & R basics.nConditional and loop")
_data-analyst-bootcamp-for-beginners-sql-tableau-power-bi-python-excel-pandas-projects-more.webp "freeCodeCamp.org")
⏲ 19 hours 23 minutes 46 seconds 👁 378.7K
_numpy-and-pandas-tutorial-124-data-analysis-with-python-124-python-tutorial-for-beginners-124-simplilearn.jpg)
_glafc-gla-1-stream-labs-python-for-data-analytics-numpy-and-pandas-18-dec-friday-715-815.jpg)
_data-analysis-with-python-full-course-for-beginners-numpy-pandas-matplotlib-seaborn.jpg)
_data-analysis-with-python-course-numpy-pandas-data-visualization.jpg)
_python-101-learn-the-5-must-know-concepts.jpg)
_numpy-vs-scipy.jpg)
_demo-data-science-master-training-trainer-kumar.jpg)
_data-analyst-bootcamp-for-beginners-sql-tableau-power-bi-python-excel-pandas-projects-more.jpg)
![[+]](/images/menu.gif){kind=small}