Q-learningQ-learning is a model-free reinforcement learning algorithm to learn the value of an action in a particular state. It does not require a model of the environment (hence "model-free"), and it can handle problems with stochastic transitions and rewards without requiring adaptations. For any finite Markov decision process (FMDP), Q-learning finds an optimal policy in the sense of maximizing the expected value of the total reward over any and all successive steps, starting from the current state.
Chinese space programThe space program of the People's Republic of China is about the activities in outer space conducted and directed by the People's Republic of China. It involves the capacity to enter and return from space and ability to engage in space exploration, utilization and governance. The technological roots of the Chinese space program trace back to the 1950s, when, with the help of the newly allied Soviet Union, China began development of its first ballistic missile and rocket programs in response to the perceived American (and, later, Soviet) threats.
Delayed onset muscle sorenessDelayed onset muscle soreness (DOMS) is the pain and stiffness felt in muscles after unaccustomed or strenuous exercise. The soreness is felt most strongly 24 to 72 hours after the exercise. It is thought to be caused by eccentric (lengthening) exercise, which causes small-scale damage (microtrauma) to the muscle fibers. After such exercise, the muscle adapts rapidly to prevent muscle damage, and thereby soreness, if the exercise is repeated. Delayed onset muscle soreness is one symptom of exercise-induced muscle damage.
ProsthesisIn medicine, a prosthesis (: prostheses; from prósthesis), or a prosthetic implant, is an artificial device that replaces a missing body part, which may be lost through trauma, disease, or a condition present at birth (congenital disorder). Prostheses are intended to restore the normal functions of the missing body part. Amputee rehabilitation is primarily coordinated by a physiatrist as part of an inter-disciplinary team consisting of physiatrists, prosthetists, nurses, physical therapists, and occupational therapists.
BiomechanicsBiomechanics is the study of the structure, function and motion of the mechanical aspects of biological systems, at any level from whole organisms to organs, cells and cell organelles, using the methods of mechanics. Biomechanics is a branch of biophysics. In 2022, computational mechanics goes far beyond pure mechanics, and involves other physical actions: chemistry, heat and mass transfer, electric and magnetic stimuli and many others.
Space Launch SystemThe Space Launch System (SLS) is an American super heavy-lift expendable launch vehicle used by NASA. As the primary launch vehicle of the Artemis Moon landing program, SLS is designed to launch the crewed Orion spacecraft on a trans-lunar trajectory. The first SLS launch was the uncrewed Artemis 1, which took place on 16 November 2022. Development of SLS began in 2011, as a replacement for the retired Space Shuttle as well as the cancelled Ares I and Ares V launch vehicles.
Artificial neural networkArtificial neural networks (ANNs, also shortened to neural networks (NNs) or neural nets) are a branch of machine learning models that are built using principles of neuronal organization discovered by connectionism in the biological neural networks constituting animal brains. An ANN is based on a collection of connected units or nodes called artificial neurons, which loosely model the neurons in a biological brain. Each connection, like the synapses in a biological brain, can transmit a signal to other neurons.
Muscle contractionMuscle contraction is the activation of tension-generating sites within muscle cells. In physiology, muscle contraction does not necessarily mean muscle shortening because muscle tension can be produced without changes in muscle length, such as when holding something heavy in the same position. The termination of muscle contraction is followed by muscle relaxation, which is a return of the muscle fibers to their low tension-generating state.
Dynamic positioningDynamic positioning (DP) is a computer-controlled system to automatically maintain a vessel's position and heading by using its own propellers and thrusters. Position reference sensors, combined with wind sensors, motion sensors and gyrocompasses, provide information to the computer pertaining to the vessel's position and the magnitude and direction of environmental forces affecting its position. Examples of vessel types that employ DP include ships and semi-submersible mobile offshore drilling units (MODU), oceanographic research vessels, cable layer ships and cruise ships.
Air traffic controlAir traffic control (ATC) is a service provided by ground-based air traffic controllers who direct aircraft on the ground and through a given section of controlled airspace, and can provide advisory services to aircraft in non-controlled airspace. The primary purpose of ATC worldwide is to prevent collisions, organize and expedite the flow of air traffic, and provide information and other support for pilots. Air traffic controllers monitor the location of aircraft in their assigned airspace by radar and communicate with the pilots by radio.
Safety valveA safety valve is a valve that acts as a fail-safe. An example of safety valve is a pressure relief valve (PRV), which automatically releases a substance from a boiler, pressure vessel, or other system, when the pressure or temperature exceeds preset limits. Pilot-operated relief valves are a specialized type of pressure safety valve. A leak tight, lower cost, single emergency use option would be a rupture disk. Safety valves were first developed for use on steam boilers during the Industrial Revolution.
Feed forward (control)A feed forward (sometimes written feedforward) is an element or pathway within a control system that passes a controlling signal from a source in its external environment to a load elsewhere in its external environment. This is often a command signal from an external operator. A control system which has only feed-forward behavior responds to its control signal in a pre-defined way without responding to the way the load reacts; it is in contrast with a system that also has feedback, which adjusts the input to take account of how it affects the load, and how the load itself may vary unpredictably; the load is considered to belong to the external environment of the system.
