This series of posts revolves around creating operational semantics of the Scheme programming language from the ground up, starting with the lambda calculus.
Trucking along, we are gonna add some more features that make our language much more usable. Lets list them out:
- Let-expressions to bind variables.
- Multi-argument functions
- First-class continuations
- Variable mutation
These features are pretty integral to modern Scheme programming. After we implement these we will be one step closer to a bog-standard Scheme that anyone can implement in 1 line of Python with
Lets take a look at the machine transitions that we have so far, to give a quick refresher of where we are at.
Old Eval Rules
These rules evaluate syntax until a value is able to be produced by our atomic-evaluation function .
Old Apply Rules
Once our control is a value, we have reached an apply state. From here, we look to our continuation for... continuation.
The Next Machine
Luckily, we don't have any big roadblock here, we can simply implement these new features one by one! Lets start with our domains:
These will again be remarkably similar, we are only adding a few things to our language.
We have added 3 expression types, the
set! expressions. We will discuss and implement them soon. Also of note here is that we changed our 'untagged' function call syntax to allow any non-zero number of expressions.
From our prior semantics, I will have to change the rules related to function calls to accomodate this change. However, the other rules can stay in our semantics unharmed.
Our semantic domains are similarly similar, only a few additions and one slight change.
Changes I made here were to the
Addr domains. Now, continuations can be a value held in a variable, to obtain one, you must go through the new
callcc Kontinuation. We added 3 continuation types: for
set!, and for the multi-arg
call. I removed the old continuations pertaining to function calling. Finally, the second number added to the address domain is required to support multiple argument functions.
The syntax of the variables inside the
call continuation may be new. The overhead-arrow means the variable is a list. When we call a function, we need to keep track of the values that we have processed, and which expressions we have yet to process. Therefore, the first argument is a list of values, which correspond to the evaluated arguments of the call-list. The second argument is that list of unevaluated expressions. We will discuss how they work when we implement the call semantics.
Last, let's recapitulate our helper functions.
Only a small change to the
alloc function to allow the second argument. This second number is used as an 'offset' to the address, and will be utilized when we call functions.
Now that we have defined our domains, lets start writing transition rules!
If you are an astute computer scientist, you will know of the isomorphism between function calls and let expressions. We will utilize it to create a dead-easy let implementation here.
What I mean to say is that a
let expression in Scheme is equivalent to calling a function. Here is an example to illustrate my point:
(let ([x 1] [y 2]) (if x y 3))
This expression binds 2 variables,
y, where they are usable in the
if expression immediately after. In a standard scheme implementation, this expression is semantically equivalent to:
((λ (x y) (if x y 3)) 1 2)
The difference is only in style. The first expression conveys the meaning of binding variables to values and then using them in an enclosed expression. The second is about calling functions to return some value. For the lazy semanticist, however, we can easily implement
let in terms of this function call.
This rule is a simple syntactic transformation. If we wanted, we could use a whole
let continuation frame, and evaluate it so similarly to a regular function call that it would bore everyone. Trust me, I've done it, it is quite tiresome! But if you want to grow your semantic-construction chops, then please implement
let explicitly! I would be happy to commend you on your effort, dear reader.
Call With Current Continuation
Call with current continuation, or
call/cc for short, is a way of obtaining the continuation of the current state, and using it like a regular value. I have written about continuations before, so I will be a bit more straightforward with my implementation notes here. In my experience though, I did not truly understand continuations until I implemented this feature in an abstract machine.
Also, I am switching to implementing the whole feature at once, instead of writing out all eval rules and then all apply rules. I think this method is a bit easier for understanding how a feature works, as you can see how they work in concert, side by side.
Here, we specify that call/cc can only take a one-arg function, and fills its argument with the current continuation. The name makes a lot of sense now! Call the given function... with the current continuation!
What can be done with the continuation value though? To find out, read on! We will cover that when we implement our
Mutation is the altering of live variables. Up to this point, variables have been immutable. You could shadow a variable, but once the shadow goes out of scope, the original value will be returned. If we wanted to mutate a variable for real, we need language support. Enter the
So mutation modifies only the store, which is new for us, usually we alter both in tandem. So that's fun.
Anyway, the semantics of
set! are very simple. In these semantics, I return the old value of the variable, but usually set! returns
Void. You can do that: add a
Void constant to your values domain, and return that. I just felt like keeping the semantics a little smaller.
Lastly, we need to implement calls. This will include continuations, so stay tuned!
Here, when we create the
call continuation, we initialize our list of finished values (our 'done' list) with epsilon
ϵ, which we use as the empty list. We also mark our arguments es as the 'todo' list of expressions. If no arguments are given (e.g. in the expression
((λ () 3))), then it will of course by empty.
We next need a rule for the in-between states of 'finished evaluating an argument, but have more to do'
In this case, we have finished evaluating an argument, but still have unevaluated arguments left. This is notated by the double-colon operator which denotes
e as the head of the todo-list, and the
e with an arrow as the tail of the list. The double-plus sign symbol is a list-concatenation operator.
Here, we have finally utilized our new
alloc functions offset feature! It's needed here because the amount of elements in the old store will remain constant for the entire transition, so we need a way to differentiate each variables address in the new store.
There is an implicit iteration here, with the
i variable used. This is a nicety of the pseudo-code nature of these semantics, that we do not have to write out what to do any more explicitly than this.
i is a number up to the amount of formal parameters of the function, so if we are calling a 3 argument function, then there will be 3 iterations of each of the variables using the
Overall, this is almost completely the same as the old calling semantics, but with additions to allow for multiple parameters.
Finally, the long awaited rule for using continuations! You really stuck it out just for this, I'm sure! The exciting conclusion of todays semantics!
Without further ado
I'm not sure why I'm stalling this ....
Actually nice and simple! Continuations can be used like functions in Scheme. When they are called with an argument, the Kontinuation of the next state is set to the continuation being 'called'. This type of continuation is called an 'undelimited escaping continuation', which basically means its goto... so don't go crazy with it!
We have implemented some great features here today! Lets do a quick example to showcase them!
I separated out the longer continuations because they were getting LONG!
Alas, for this example, in the end, most of that computation was perfectly useless. But it happened, because this is a NO OPTIMIZATION ZONE! No optimizations in 3 days so far, a new warehouse record. It's hard to find comedy in Computer Science sometimes, sorry. I have been telling that '2 hard problems in CS' joke for near 10 years...
As you see, the machine performs admirably up to these new inputs. I did not feature
set!, because this example was crazy enough! Make a
set! example yourself, and write out the states by hand, it really helps understand the machine better!
Another briskly paced post today! I hope you gained some intuition of these machines by this repeated style of implementation. If you think that it's a bit boring, then good! That means you have it down, and this repetition is simply icing on the cake of your semantic knowledge. There will be probably one more post of this caliber before I start to crank it up with more esoteric stuff, so savor the boredom while it lasts!
Next post, I will add other callable types, such as primitives and variadic functions. After that, the machine should be about as done as I want it to be, and our concrete interpreter will be finished. I have future plans though! I want to write about abstract interpretation, and static analysis. I will convert our 'concrete semantics' into 'abstract semantics', so that we can statically analyze programs in our language.