The reactor control room is on the ground floor right below where you entered. There are two ways of accessing the reactor control room. Finding the reactor control room door should be simple enough as it will be clearly.
