Featured

Stephen Friess, M.Sc.

Fries,,Steffen 61Theoretical Physicist with a research focus on Machine Learning and Computational Intelligence.

Stephen previously studied at the Technical University of Darmstadt where he did research for his BSc (2013) on effective field theories and quark matter in the Nuclei, Hadrons & Quarks group of PD Dr. Michael Buballa and for his MSc (2016) on neutrino reactions in proto-neutron stars in the Theoretical Nuclear Astrophysics group of Prof. Dr. Gabriel Martínez-Pinedo. Prior to starting his role as Marie Curie Fellow on project ECOLE (2018), he worked for a German-based software company. Funded by the European Commission, he works on the topic of ‘Learning in Evolutionary Search’ for his European Industrial Doctorate (EID). He is being supervised at the University of Birmingham by Prof. Xin Yao and Prof. Peter Tiňo, while Dr. Stefan Menzel and Dr. Zhao Xu provide industrial co-supervision at Honda Research Institute Europe and NEC Laboratories Europe.

Research Interests: Nature and bio-inspired Artificial Intelligence, Machine Learning, Methods from Applied Mathematics and Physics.

Professional Memberships: German Physical Society (DPG eV), student memberships in AAAI and SIGEVO.

Hobbies / Trivia: I ocassionally blog, write scifi shorts and do hackathons. Among my favourite movies are Matrix, Gattaca and Memento. My favourite old-school early 20th century scientist is the fascinating but also controversial John von Neumann.

Social Media:  LinkedIn, Twitter

 

Advertisements

From Quarks, Neutrinos and Neutron Stars to Evolutionary Algorithms

 

We are living in crazy times. I wrote about studying Machine Learning at the start of the year, updated the article last month about working on a spare time project and now I already have a position as a PhD student on very promising research in sight.

I have accepted the offer to join the ITN ECOLE project funded under the EU Horizon 2020 Marie Curie Skłodowska actions. Horizon 2020 is with 80 billion euros currently the largest funded research initiative by the European Commission. I will be working together with an international tech company and the University of Birmingham on the intersection between evolutionary algorithms and currently popular machine learning algorithms.

It is not just crazy research drawing inspirations from many interesting fields, but also promising and practical in terms of applications. Therefore, I am very excited about beginning my work at the University of Birmingham in September. But I further plan on keeping this blog about spare time projects.

Feel free to take a look at my slides I prepared for my talk I gave for the application.

 

How I got into Machine Learning

Machine Learning first caught my interest while working for a Data Science start-up after my studies. I found the way how a mathematical framework can be used for enumerable applications ranging from predictive maintenance, to language processing over visual recognition tasks deeply fascinating. Visiting a seminar of the German Physical Society in July 2017, I further met a PhD graduate who after finishing his thesis about ‘cold quantum gases’ became an AI developer. He particularly suggested everyone who has interest in the field to take the online courses offered by Stanford University professor Andrew Ng.

It took not long for me to register on Coursera and work on my first machine learning course. Despite having a full-time position at my new job, I was hooked to the lectures and finished them quickly. The new courses offered by Ng’s website DeepLearning.ai immediately followed.

702b0c5805e8e5789cb0edab2e75b06b[1]
Obligatory picture of an artifical intelligence from Star Trek.
 I especially find it fascinating that there exist some vague analogies to the brain. Feature detectors discovered in neuroscientific experiments from Hubel and Wiesel resemble filters used in convolutional neural networks. Further analogies are also implied between the spike-timing plasticity mechanism discovered by neuroscientists and recirculation algorithms for NN .

But ML research and neuroscience are like apples and oranges. And we barely know anything about how the actual brain works. At a talk I attended, researcher Jürgen Schmidhuber compared neuroscientists to 20th century electricians trying to figure out how a 21st century smartphone works. And if you read some literature on neuroscience, you will come to the very same conclusions. So the recent achievements and progresses in ML theory are decoupled from any neuroscientific basis.  And the most important ingredient of machine learning, the backpropagation algorithm, is also still searching for a biological analogy. Although one has to mention, that some first ideas are being investigated.

I hope in the future I further find the time to work on a machine learning project of my own. If anyone has any cool and interesting suggestions, feel free to  contact me .

Update (2018-06-05): I recently started working on generative models (VAE & GANs). I will keep this blog updated about any progresses.

Update (2018-07-01): I got a PhD position in Computational Intelligence.

Java-based Tool for Image Filtering and Vessel Diameter Measurements of Medical Images

Visiting the course on Human Computer Systems at my university, I learned about various image filtering techniques used in medical computing. A quite interesting exercise I found to test some of my knowledge in the field was to determine vessel diameters in medical images.

I solved the problem by implementing different filtering techniques in a Java-based tool. Given an input image, the tool applies stepwise a grayscale conversion, a noise filter, a laplace filter (edge detection) and finally a binary filter.

intensity_profile

The 2d intensity map derived in the last step can be used to extract vessel diameters. Provided some measurement points inside the vessels, the tool does this automatically by measuring the 1d intensity profile along a line and trying to minimize the distance between two peaks (i.e. the wall distance) in the intensity profile by variation of the inclination angle.

Overall it was a fun little project. Especially seeing how the combination of filters worked out as intended was great.

You can find the tool at my GitHub account: VesselDetector-13-03-17.rar.

Stochastic Cellular Automaton

Fascinated by the cellular automata engine from Mirek Wojtowicz (MCell 4.20) and the multi-agent evolution simulator from Björn Seekatz (Bugs Evolution), I always wanted to create my own rule-based ‘biophysical’ simulation. Particularly to investigate the dynamics of adaptation through evolutionary processes. Final inspirations struck me as I watched a video of a microbial evolution study done in a joint venture of Havard Medical School and the Technion Israel Institute of Technology.

The video shows a growing microbial film successively evolving resistances against antibiotic stripes arranged in rising concentration towards the center.

In a similar way I recreated the behaviour of the biofilm within a cellular automaton. For this I considered the following rules: A living cell has a color type, a maximum age, a birth rate, a mutation rate as well as attack and defence values. The value of the maximum age,  birth rate,  mutation rate as well as attack and defence value can further change by spontaneous mutations (thus the cellular automaton is stochastic and not deterministic). The defence value is a number which protects a cell. If a cell of e.g. a red species tries to grow into a cell of a green species, the attack value of the red cell has to match the defence value of the green cell. The results of the run of a ‘simulation’ can be seen above at three different points in time. Below you find a still frame of a simulation with further two different visualization modes.

The first picture shows two species of ‘molds’ with the color red and green. The brightness indicates the generation number of a subspecies formed by spontaneous mutation. Older generations of a subspecies have lower generation number and are brighter, while newer generations of a subspecies have higher generation number and are darker. The green species developed at an early age mutations with a higher birth rate, thus managed it to expand further than the red species. The second picture shows a heatmap of the generations, the third picture the rate of mutations per birth.

I find it very fascinating that similar to the video you can see the formation of ‘cones’ whenever a new subspecies is spawned by spontaneous mutations. Further by playing around with some of the settings, the automaton allows one to test a variety of different scenarios for evolutionary processes.

You can find the Eclipse project of the Stochastic Cellular Automaton at my GitHub account (names of the included files may differ): StochasticCellularAutomaton .

Master’s Thesis: Weak Interaction Processes with Spectator Nucleon in the Proto-Neutron Star (2016)

 

During my Master’s studies I attended a seminar on theoretical problems of nuclear physics. I particularly worked on a term paper about the nuclear physics of neutron stars. Because doing research on astrophysical problems felt very refreshening for me, I decided to switch to theoretical nuclear astrophysics for my Master’ thesis.

elephant_entr2317
Cross section of the entropy distribution of a 3d supernova simulation. Source: https://compstar.uni-frankfurt.de/

Working in the TNA group was different to my prior experiences. I really enjoyed working in such a diverse team. I became known for my coffee drinking habits and particularly recall one weary morning at which a bugged out PhD student complained to me about having too much. In his defence: The coffee machine was standing right on his desk and was always making loud noises.

I finished my thesis in March 2016 and defended it with great success! The 80 pages long work studies the mathematical framework used to calculate neutrino reactions in hot dense matter (by this we mean the proto-neutron star), investigates the behaviour of known basic reaction processes for a data set stemming from a core-collapse supernova simulation, criticizes heuristic methods which are used to extrapolate the framework to more complicated modes of interaction and contains analytical calculations of the more complicated interactions.

neutrinoreactions
Source: Janka et al.

The study of neutrino reactions in nuclear astrophysics is particularly interesting in order to better understand the dynamics of core-collapse supernova and the resulting observable neutrino signal.

If you are interested, feel free to read through my thesis and presentation:
Master’s Thesis
Presentation of my Master’s Thesis

I also wrote a nice introductory article on weak interaction processes in nuclear astrophysics for the website of my former work group:
Weak interaction processes in astrophysics

Ludum Dare 33 & 34 Contributions: The Horrific Game Show and the Authentic Roman History Simulator (2015)

During the Serious Games seminar I got to know a fellow computer science student named Alvar who invited me to participate with him in the hackathons hosted at the multimedia communications lab of the factuly of electrical engineering and information systems. Because I always wanted to work on a video game from the scratch, I did not hesitate to accept the invitation. The hackathons were coupled to globally organized Ludum Dare game jams with thousands of people from around the world simultaneously participating for three days.

Alvar and I immidiately formed a very effective duo. We specialized in making small but humorous games. While Alvar mostly worked on building the game logic in Unity,  I specialized on game design. Researching ideas for the theme, writing dialogs and juvenile jokes, making graphics, finding the right music, finding the right sounds and even recording dialog. And of course coming up with entertaining eastereggs. And all has to be put together in a way at the end so that the pacing and presentation is pleasurable. At times we both got into conflict over creative decisions. But at the end, both of our games for Ludum Dare 33 and Ludum Dare 34 turned out very well.

Our Ludum Dare 33 contribution ‘Y.A.T.M – You Are The Monster’ was ranked #16 in the category humor. For Ludum Dare 34, ‘The Authentic Roman History Simulator – 44 B.C. Edition’ even further ranked #8 in category humor and #30 in category theme from more than 2000 (!!) contributions in total.

You can try out our games for yourself at the following links:

Y.A.T.M. – The Horrific Game Show
Authentic Roman History Simulator – 44 B.C. Edition