DATA ENGINEERING
Spark Structured Streaming
Recently reading a blog Structured Streaming in PySpark It's implemented in Databricks platform. Then I try to implement in my local Spark. Some tricky issue happened during my...
The notebook / 64 articles
Ideas into practice
Notes on LLMs, machine learning, data engineering, and the systems that make them work.
Showing 61–64 of 64 posts
MACHINE LEARNING
Gradient Descent
Vanilla gradient descent, aka batch gradient descent, computes the gradient of the cost function w.r.t. to the parameters θ