We build upon the fully convolutional masked autoender ConvNeXt-v2 to introduce the first line-level self-supervised framework for Handwritten Text Recognition. The standard masking strategy used for natural images is inadequate for text recognition needs so we propose a strategy dedicated to HTR. We further propose to model language during pretraining…
KIHT project Presentation The aim of the KIHT project is to develop an intelligent learning device (« DigiPen » electronic pen) for digitized handwriting. The electronic « DigiPen » hardware is designed by STABILO with the help of the German Karlsruhe Institute of Technology (KIT). Digital devices can help pupils and teachers in the…
The Synthetic Text line Image Generator (STIG) is a software dedicated to handwritten textline generation. It is available for free under conditions (see below). Description The Synthetic Text line Image Generator is a Python code dedicated to the generation of synthetic handwritten textline images. The software can generate textlines looking…
The Modular Light Transformer (MLT) is a software dedicated to text recognition. It is available for free under conditions (see below). Description The Modular Light Transformer is a software dedicated to text recognition. It is based on a lightweight Transformer-based neural network dealing with text-line images. The proposed software is…
We present our gesture-based interaction system for multitouch surfaces, called Evolve-Touch. The main feature of our system is its personalization capacity so that user can define his set of gesture and add new gestures at any moment. The system is based on our evolving recognition engine, Evolve++ that can be…
Varchitect is a Windows Store application that was developped as part of the effort to port the Evolve++/EvolveTouch system to current tablet operating systems. With Varchitect, users can define their own set of gesture commands to insert furniture or architectural elements in a plan, and then design their interior…
Vscript is an Android application that was developped as part of the effort to port the Evolve++/EvolveTouch system to current tablet operating systems. The application is available on Android’s Play Store. Vscript is a handwriting learning application/game for children. It is meant to be used on android tablets with a…
Contact : Eric Anquetil, Adrien Delaye, Pei-yu Li Before being able to use pen-based interfaces or finger-based interfaces, user has first to get familiar with the vocabulary of gestures, but gestures are not self-revealing by nature and can be difficult to memorize. A way to assist the user in memorizing…
It is the library on which the DocRead software is based. It is composed of various methods of adaptive binarization. Those use either local determination of threshold or edge detection and region growing cooperation. Some of these methods can provide results with a sub-pixel resolution. Using Kalman filters, this library…
Contact : Eric Anquetil ( eric.anquetil@irisa.fr), Sébastien Macé The Imadoc research team has developed DALI, a framework for the design of pen-based software for structured document composition. DALI is based on a grammatical formalism making it possible to describe such document composition rules [Macé&Anquetil, ICDAR’07]. This framework has been transferred…