Thursday, 3 July 2025

The Power is INDEED the LLAMA

Llama 4 ("Leading Intelligence") is out. 

There is something called the Llama 4 Community License Agreement. This states you can use Llama models in derived products - but you must tell the world you are using Llama and what version it is.

Machine Unlearning

As a machine learns, so must it unlearn.  

This ability is needed if an LLM ingests copyrighted content or personal data - it must be able to unlearn information it is not permitted to have. This could also apply to fallacious or untrusted data.

IBM in an article have noted the lack of industry wide tools to evaluated the effectiveness of unlearning.

The IBM piece also highlights research by Microsoft on machine unlearning. This also states the problem of the high cost of retraining models (this costly training process is what has spiked demand for GPUs).

A research paper, which styles itself as a "bridge" paper between unlearning research in classification models to unlearning in generative models focusing on the I2I (image-to-image) generation space.

In the IBM article, the writers go on to describe the SPUNGE framework they have developed for machine unlearning (SPUNGE being short for Split, Unlearn, Merge).

Tuesday, 1 July 2025

Concept of LoRA or Low Rank Adapation in LLMs

LoRA is an approach to optimizing LLMs by reducing the "size" of the matrix of trainable parameters, as measured by "rank" of the matrix i.e. the number of linearly independent rows or columns.

What is RIO in RDF? Is it relevant post OpenRDF?

RIO is the "RDF Input/Output" toolkit.  

The RIO appellation persists even in the post OpenRDF world.

RIO was part of OpenRDF and is now part of RDF4J. Docs are here

These parsers and writers can be used independently of the rest of the RIO library. An important parser in the toolkit is the RDFHandler, which receives parsed RDF triples.  This can be used as a pure listener, or as a reporting tool (being passed to a function that needs to report results back).

It's good to understand RIO both for comprehending legacy messages from OpenRDF and also more recent exceptions from RDF4J.

OpenRDF Usage in Blazegraph

Blazegraph (no longer maintained and unofficially superseded by Amazon Neptune) uses OpenRDF under the hood (rather than the renamed version RDF4J).

This can be found by forcing an exception in the Blazegraph workbench:

org.openrdf.rio.RDFParseException

By typing in some bad syntax into the Update window. Typing "hello world" will do nicely.

Why does Copilot want to rewrite my RDF when it doesn't know how?

Copilot wants to change the "tone" of an RDF file created by Windows Joe which will consume AI credits. This tone could be Formal, Casual, Inspirational or Humor (Sic).  Um, no thanks Copilot. 

What is Turtle in the World of Semantic Web?

Turtle is a type of notation and a W3C Recommendation since February 2014.  

Its full name is Terse RDF Triple Language. 

It is one of a family of ways to write RDF, also known as RDF serialization formats. Turtle's plus point is that it is user-friendly (and less verbose, than say, XML).

Turtle's official documentation states that it:

 "allows an RDF graph to be completely written in a compact and natural text form, with abbreviations for common usage patterns and datatypes. Turtle provides levels of compatibility with the N-Triples [N-TRIPLES] format as well as the triple pattern syntax of the SPARQL W3C Recommendation".