Tagged | apache-spark

• Optimisation using Sparklens

  (medium.com)

  #performance #apache-spark #data-engineering

• Advanced schema management for Spark applications at scale

  (engineering.linkedin.com)

  #DBMS #scaling #distributed-systems #apache-spark

• Supporting Spark as a First-Class Citizen in Yelp’s Computing Platform

  (engineeringblog.yelp.com)

  #data-pipeline #distributed-systems #apache-spark #big-data #backend

• Our Journey to Optimal Job Sizes for Apache Spark

  (engineering.salesforce.com)

  #data-pipeline #software-architecture #distributed-systems #apache-spark #backend

• Making Apache Spark Effortless for All of Uber

  (eng.uber.com)

  #software-architecture #DBMS #distributed-systems #apache-spark #data-engineering

• Presentation: Productionizing H2O Models with Apache Spark

  (www.infoq.com)

  #data-pipeline #data-science #software-engineering #machine-learning #apache-spark

• Real-time data processing for monitoring and reporting — A practical use case of spark structured…

  (medium.com)

  #data-pipeline #stream-processing #distributed-systems #apache-spark #data-engineering

• Scaling Spark Streaming for Logging Event Ingestion

  (medium.com)

  #data-pipeline #logging #apache-spark #event-driven

• Scaling up with Distributed Tensorflow on Spark

  (towardsdatascience.com)

  #deep-learning #distributed-systems #apache-spark

• SQL at Scale with Apache Spark SQL and DataFrames — Concepts, Architecture and Examples

  (towardsdatascience.com)

  #DBMS #scaling #apache-spark #SQL

• How we built a data pipeline with Lambda Architecture using Spark/Spark Streaming

  (medium.com)

  #data-pipeline #distributed-systems #data-stream #apache-spark

• Detecting image similarity using Spark, LSH and TensorFlow

  (medium.com)

  #deep-learning #image-processing #apache-spark #tensor-flow

• Apache Spark - Performance

  (blog.scottlogic.com)

  #performance #distributed-systems #apache-spark #big-data

• Scaling Collaborative Filtering with PySpark

  (engineeringblog.yelp.com)

  #scaling #apache-spark #python

• Continuous Deployment with Spark Streaming (Part II)

  (eng.wealthfront.com)

  #data-pipeline #automation #CI-CD #apache-spark

• Continuous Deployment with Spark Streaming (Part I)

  (eng.wealthfront.com)

  #devops #CI-CD #apache-spark

• Data Analysis with Spark

  (jobs.zalando.com)

  #data-analytics #apache-spark #big-data

• How to hack Spark to do some data lineage

  (blog.octo.com)

  #data-pipeline #apache-spark #big-data #hadoop

• PageRank in Spark

  (developers.soundcloud.com)

  #search #apache-spark #big-data

• Scaling Gradient Boosted Trees for CTR Prediction - Part I

  (engineeringblog.yelp.com)

  #data-pipeline #data-science #machine-learning #apache-spark

• Graceful Degradation in Spark Streaming Applications

  (eng.wealthfront.com)

  #distributed-systems #data-stream #apache-spark

• How To Predict ICU Mortality with Digital Health Data, DL4J, Apache Spark and Cloudera

  (blog.cloudera.com)

  #machine-learning #java #apache-spark

• Druid and Spark Together – Mixing Analytics Workflows

  (metamarkets.com)

  #noSQL #data-analytics #apache-spark #druid

• How We Optimize Apache Spark Jobs

  (rea.tech)

  #optimisation #distributed-systems #apache-spark

• Deep Learning with Intel’s BigDL and Apache Spark

  (blog.cloudera.com)

  #deep-learning #apache-spark #bigDL

• Developing Custom Machine Learning Algorithms in PySpark

  (databricks.com)

  #machine-learning #apache-spark #python

• Setting up Spark Streaming - Part II

  (tech.showmax.com)

  #data-analytics #data-stream #apache-spark