Projects / Gakachu

Robot Artist and Entrepreneur

Gakachu

Gaka-chu (from Japanese 画家 — gaka — artist, chu — in honor of Pikachu) is an industrial 6 axis manipulator, that has been re-equipped to draw with brushes and paints and provided with the software to sell its works and maintain self-sufficiency. Gaka-chu allows us to look beyond the line that separates robots as tools and robots as peers.

Mission

Anathomy from human

To dive into the concept of an “autonomous creative system,” we tried to make Gaka-chu as independent of a human as possible. This allowed us to explore a completely gray area where robotic systems become authors and even owners of assets.

Generation ideas for art

We bypassed the most difficult task for AI — imagination — by concentrating on finding topics and ideas for paintings that would be interesting to sell. To do this, we use Microsoft Azure cognitive services to select keywords of interest to humanity from publications and posts on social networks or forums. So, we erode the concept of authorship, so that in the end there is nothing left but to acknowledge the authorship of the robot.

Drawing with a brush

Gaka-chu can draw Japanese kanji characters that mean a keyword or prepared simple images (such as logos). This requires several components to work together (sensing, planning, actuation), which includes, for example, transforming the canvas coordinates and solving the inverse kinematic.

Selling artworks for cryptocurrency

The robot has its own cryptocurrency wallet on the Ethereum platform, and with the help of software it can perform transactions on the network. In particular, the robot is able to create non-fungible tokens (NFT) based on the created paintings, put them up for auction and use the received cryptocurrency.

Automatic purchase of drawings consumables

The main task of a robot as an entrepreneur is to support its activities using the accumulated capital. We ran an experiment in which Gaka-chu purchased canvases, paints, and brushes from a test automated system of an art shop, paying for the order with cryptocurrency.
OpenSeaRarible

Tech details

HardwareManipulator KUKA KR6 R900 with Intel RealSense D435i depth camera and Intel NUC NUC7i5BNB (Intel Core i5-7260U, 3.40 GHz, 8 GB RAM) for image and motion processing
HardwareManipulator KUKA KR6 R900 with Intel RealSense D435i depth camera and Intel NUC NUC7i5BNB (Intel Core i5-7260U, 3.40 GHz, 8 GB RAM) for image and motion processing
Main software connectorRobot Operating System: all components are implemented as ROS packages and nodes
Image processing softwarelibrealsense ROS package, OpenCV library for image skeletonization
Motion planningMoveIt Motion Planning Framework with own module for inverse kinematics
NTF mining and auctionOpenSea platform with its SDK
Agent-agent economic interactionRobonomics Network with AIRA client: provides the ability to send transactions to the Ethereum network
Data storageInterPlanetary File System

R&D interests

  • Solving the inverse kinematics for 6 axis manipulator control when drawing.
  • Task of web scraping for extracting the data for painting topics.
  • Using cognitive technologies to generate topics.
  • Determination of the working space using a depth camera.
  • Finding the most profitable topics using statistics from the sale of paintings.

Media

Gaka-chu profiles

Github repositoryYouTubeOpenSeaRarible