AI ENGINEERING
Gradio with Ollama
Notes on processing unstructured PDF content and a demo architecture connecting a Gradio interface to models served by Ollama.
From the archive
2024
Everything published in 2024.
DATA ENGINEERING
PySpark Dataframe Transformation
Notes on moving from Scala to PySpark, using Python dataclasses for data models, and creating DataFrames from Row objects.
DATA ENGINEERING
Databricks Wheel Job
Recently I successfully deploy my python wheel to Databricks Cluster. Here are some tips if you plan to deploy pyspark.
SOFTWARE ENGINEERING
ZIO
Recently I read a Blog that introducing how to use scala framework ZIO to build an application.
SOFTWARE ENGINEERING
Reflex Learning
Reflex is a library to build full-stack web apps in pure Python.
DATA SCIENCE
Snowflake Data Science Training Summary
I have enrolled in a private Snowflake Data Science Training. Let me list what I learned from it.
AI ENGINEERING
AutoGen HttpClient
Now we can add our proxy config in our client, which will resolve connection issue.
SOFTWARE ENGINEERING
How to execute python modules
We can use internal runpy to execute different moduls in our project.
MACHINE LEARNING
Model Registry
Problem: How to introduce ml-based production/features to cross-functional teams.