Optimizing liquid neural networks: a comparative study of ltcs and cfcs

Abstract

Liquid Time Constant Networks (LTCs) and Closed Form Continuous Networks (CFCs) are recent time-continuous RNN models known for superior expressivity and efficiency in time-series prediction and autonomous navigation. This paper provides an accessible overview of these models and investigates their performance on tasks like Atari ’Breakout’ behavior cloning, steering angle prediction, and Global Horizontal Irradiance (GHI) forecasting. We optimize LTC and CFC cells within network structures, comparing them with LSTM. Detailed experiments highlight the impact of various hyperparameters, underscoring the effectiveness of LTCs and CFCs in dynamic prediction tasks.