Bin Zhang Data, AI, and engineering notes
Home Blog Archive

Tags

  • #agents
  • #autogen
  • #cloud
  • #containers
  • #data platform
  • #dataframe
  • #deep learning
  • #etl
  • #functional programming
  • #langchain
  • #langgraph
  • #leadership
  • #linear algebra
  • #llm apps
  • #llm fundamentals
  • #llmops
  • #mcp
  • #mlops
  • #model training
  • #optimization
  • #orchestration
  • #python
  • #rag
  • #spark
  • #sql
  • #streaming
  • #tool use
  • #web development

PySpark Dataframe Transformation

November 15, 2024
DATA ENGINEERING
sparkpythondataframe

```python linenums="1" spark = ( SparkSession.builder.master("local[]").appName("test").getOrCreate() ) d = [ Event(1, "abc"), Event(2, "ddd"), ]

Spark Dataframe window function

March 1, 2020
DATA ENGINEERING
sparkdataframe

scala ref create dataframe

© 2026 Bin Zhang. All rights reserved.