TechTalks from event: Technical session talks from ICRA 2012

Conference registration code to access these videos can be accessed by visiting this link: PaperPlaza. Step-by-step to access these videos are here: step-by-step process .
Why some of the videos are missing? If you had provided your consent form for your video to be published and still it is missing, please contact


  • On the Number of Local Minima to the Point Feature Based SLAM Problem Authors: Huang, Shoudong; Wang, Heng; Frese, Udo; Dissanayake, Gamini
    Map joining is an efficient strategy for solving feature based SLAM problems. This paper demonstrates that joining of two 2D local maps, formulated as a nonlinear least squares problem has at most two local minima, when the associated uncertainties can be described using spherical covariance matrices. Necessary and sufficient condition for the existence of two minima is derived and it is shown that more than one minimum exists only when the quality of the local maps used for map joining is extremely poor. The analysis explains to some extent why a number of optimization based SLAM algorithms proposed in the recent literature that rely on local search strategies are successful in converging to the globally optimal solution from poor initial conditions, particularly when covariance matrices are spherical. It also demonstrates that the map joining problem has special properties that may be exploited to reliably obtain globally optimal solutions to the SLAM problem.
  • On the Comparison of Uncertainty Criteria for Active SLAM Authors: Carrillo, Henry; Reid, Ian; Castellanos, Jose A.
    In this paper, we consider the computation of the D-optimality criterion as a metric for the uncertainty of a SLAM system. Properties regarding the use of this uncertainty criterion in the active SLAM context are highlighted, and comparisons against the A-optimality criterion and entropy are presented. This paper shows that contrary to what has been previously reported, the D-optimality criterion is indeed capable of giving fruitful information as a metric for the uncertainty of a robot performing SLAM. Finally, through various experiments with simulated and real robots, we support our claims and show that the use of D-opt has desirable effects in various SLAM related tasks such as active mapping and exploration.
  • Continuous-Time Batch Estimation Using Temporal Basis Functions Authors: Furgale, Paul Timothy; Barfoot, Timothy; Sibley, Gabe
    Roboticists often formulate estimation problems in discrete time for the practical reason of keeping the state size tractable. However, the discrete-time approach does not scale well for use with high-rate sensors, such as inertial measurement units or sweeping laser imaging sensors. The difficulty lies in the fact that a pose variable is typically included for every time at which a measurement is acquired, rendering the dimension of the state impractically large for large numbers of measurements. This issue is exacerbated for the simultaneous localization and mapping (SLAM) problem, which further augments the state to include landmark variables. To address this tractability issue, we propose to move the full maximum likelihood estimation (MLE) problem into continuous time and use temporal basis functions to keep the state size manageable. We present a full probabilistic derivation of the continuous-time estimation problem, derive an estimator based on the assumption that the densities and processes involved are Gaussian, and show how coefficients of a relatively small number of basis functions can form the state to be estimated, making the solution efficient. Our derivation is presented in steps of increasingly specific assumptions, opening the door to the development of other novel continuous-time estimation algorithms using different assumptions. Results from a self-calibration experiment involving a camera and a high-rate IMU are provided to validate the approach.
  • SLAM with Single Cluster PHD Filters Authors: Lee, Chee Sing; Clark, Daniel; Salvi, Joaquim
    Recent work by Mullane, Vo, and Adams has re-examined the probabilistic foundations of feature-based Simultaneous Localization and Mapping (SLAM), casting the problem in terms of filtering with random finite sets. Algorithms were developed based on Probability Hypothesis Density (PHD) filtering techniques that provided superior performance to leading feature-based SLAM algorithms in challenging mea- surement scenarios with high false alarm rates, high missed detection rates, and high levels of measurement noise. We investigate this approach further by considering a hierarchical point process, or single-cluster multi-object, model, where we consider the state to consist of a map of landmarks conditioned on a vehicle state. Using Finite Set Statistics, we are able to find tractable formulae to approximate the joint vehicle-landmark state based on a single Poisson multi-object assumption on the predicted density. We describe the single-cluster PHD filter and the practical implementation developed based on a particle-system representation of the vehicle state and a Gaussian mixture approximation of the map for each particle. Synthetic simulation results are presented to compare the novel algorithm against the previous PHD filter SLAM algorithm. Results presented indicate a superior performance in vehicle and map landmark localization, and comparable performance in landmark cardinality estimation.
  • Simultaneous Localization and Scene Reconstruction with Monocular Camera Authors: Huang, Kuo- Chen; Tseng, Shih-Huan; Mou, Wei-Hao; Fu, Li-Chen
    In this paper, we propose an online scene recon- struction algorithm with monocular camera since there are many advantages on modeling and visualization of an environ- ment with physical scene reconstruction instead of resorting to sparse 3D points. The goal of this algorithm is to simultaneously track the camera position and map the 3D environment, which is close to the spirit of visual SLAM. There’re plenty of visual SLAM algorithms in the current literature which can provide a high accuracy performance, but many of them rely on stereo cameras. It’s true that we’ll face many more challenges to accomplish this task with monocular camera. However, the advantages of cheaper and easier deployable hardware setting have made monocular approach more attractive. Specifically, we apply a maximum a posteriori Bayesian approach with optimization technique to simultaneously track the camera and build a dense point cloud. We also propose a feature expansion method to expand the density of points, and then online reconstruct the scene with a delayed approach. Furthermore, we utilize the reconstructed model to accomplish visual localization task without extracting the features. Finally, a number of experiments have been conducted to validate our proposed approach, and promising performance can be observed.
  • Rhythm-based Adaptive Localization in Incomplete RFID Landmark Environments Authors: Kodaka, Kenri; Ogata, Tetsuya; Sugano, Shigeki
    This paper proposes a novel hybrid-structured model for the adaptive localization of robots combining a stochastic localization model and a rhythmic action model, for avoiding vacant spaces of landmarks efficiently. In regularly arranged landmark environments, robots may not be able to detect any landmarks for a long time during a straight-like movement. Consequently, locally diverse and smooth movement patterns need to be generated to keep the position estimation stable. Conventional approaches aiming at the probabilistic optimization cannot rapidly generate the detailed movement pattern due to a huge computational cost; therefore a simple but diverse movement structure needs to be introduced as an alternative option. We solve this problem by combining a particle filter as the stochastic localization module and the dynamical action model generating a zig-zagging motion. The validation experiments, where virtual-line-tracing tasks are exhibited on a floor-installed RFID environment, show that introducing the proposed rhythm pattern can improve a minimum error boundary and a velocity performance for arbitrary tolerance errors can be improved by the rhythm amplitude adaptation fed back by the localization deviation.

Mobile Manipulation: Planning & Control

  • Planning with Adaptive Dimensionality for Mobile Manipulation Authors: Gochev, Kalin; Safonova, Alla; Likhachev, Maxim
    Mobile manipulation planning is a hard problem composed of multiple challenging sub-problems, some of which require searching through large high-dimensional state-spaces. The focus of this work is on computing a trajectory to safely maneuver an object through an environment, given the start and goal configurations. In this work we present a heuristic search-based deterministic mobile manipulation planner, based on our recently-developed algorithm for planning with adaptive dimensionality. Our planner demonstrates reasonable performance, while also providing strong guarantees on completeness and suboptimality bounds with respect to the graph representing the problem.
  • Unifying Perception, Estimation and Action for Mobile Manipulation Via Belief Space Planning Authors: Kaelbling, Leslie; Lozano-Perez, Tomas
    In this paper, we describe an integrated strategy for planning, perception, state-estimation and action in complex mobile manipulation domains. The strategy is based on planning in the belief space of probability distribution over states. Our planning approach is based on hierarchical symbolic regression (pre-image back-chaining). We develop a vocabulary of fluents that describe sets of belief states, which are goals and subgoals in the planning process. We show that a relatively small set of symbolic operators lead to task-oriented perception in support of the manipulation goals.
  • Distributed Cooperative Object Attitude Manipulation Authors: Markdahl, Johan; Karayiannidis, Yiannis; Hu, Xiaoming; Kragic, Danica
    This paper proposes a local information based control law in order to solve the planar manipulation problem of rotating a grasped rigid object to a desired orientation using multiple mobile manipulators. We adopt a multi-agent systems theory approach and assume that: (i) the manipulators (agents) are capable of sensing the relative position to their neighbors at discrete time instances, (ii) neighboring agents may exchange information at discrete time instances, and (iii) the communication topology is connected. Control of the manipulators is carried out at a kinematic level in continuous time and utilizes inverse kinematics. The mobile platforms are assigned trajectory tracking tasks that adjust the positions of the manipulator bases in order to avoid singular arm configurations. Our main result concerns the stability of the proposed control law.
  • A Hybrid Control for Automatic Docking of Electric Vehicles for Recharging Authors: Petrov, Plamen; Boussard, clément; Ammoun, Samer; Nashashibi, Fawzi
    In this paper, we present the architecture of an innovative docking station for electric vehicles recharging and a hybrid control scheme for automatic docking of the vehicles. This work is a part of on-going project concerning the development of a smart charging station for electric vehicles equipped with an automated arm, which connect the vehicle to the charging station, and an infrared beacon system for localizing the automatically maneuvering vehicle in the docking area. The proposed control scheme combines time-optimal (bang-bang) control with continuous time-invariant nonlinear control, which stabilizes the vehicle to a small neighborhood of the docking point. Simulation and experimental results illustrate the effectiveness of the proposed controller
  • On Continuous Null Space Projections for Torque-Based, Hierarchical, Multi-Objective Manipulation Authors: Dietrich, Alexander; Albu-Schäffer, Alin; Hirzinger, Gerd
    The technological progress in the field of robotics results in more and more complex manipulators. However, having an increasing number of degrees of freedom raises the question of how to use them effectively. In turn, establishing manipulators in human environments, e.g., as service robots, calls for the fulfillment of various constraints and tasks at the same time. In the context of torque controlled robotic systems, we provide an approach to simultaneously deal with a multitude of tasks and constraints which are arranged in a hierarchy, utilizing the large number of actuated joints of the manipulator. To this end, we propose a continuous null space projection technique to consider unilateral constraints, singular Jacobian matrices and dynamic variations of the priority order within the hierarchical structure. We show that activating and deactivating tasks as well as crossing singularities does not lead to a discontinuous control law. Simulations and experiments on the humanoid Justin of the German Aerospace Center (DLR) validate our approach. The presented concept is supposed to contribute to whole-body control frameworks.

Simulation and Search in Grasping

  • Simulating Robot Handling of Large Scale Deformable Objects: Manufacturing of Unique Concrete Reinforcement Structures Authors: Cortsen, Jens; Jørgensen, Jimmy Alison; Soelvason, Dorthe; Petersen, Henrik Gordon
    Automatic offline programming of industrial robotic systems is becoming increasingly important due to the larger percentage of desired automation of low volume tasks. Often, such tasks may involve handling of items that can have rather large deflections which are important to take into account when doing offline programming. In this paper such a problem is presented, namely robotic assembly of unique concrete reinforcement structures. Reinforcement bars of 3 meters may deflect up to around 50cm. We illustrate experimentally how the reinforcement bar can be precisely modelled by a structure consisting of rigid parts connected by ”deflection joints”. Such a model can be directly integrated into existing physics simulation engines such as the Open Dynamics Engine (ODE). Finally, we discuss how the simulation will be used for automatic offline programming and present a video with a dynamic simulation of the reinforcement assembly process.
  • Hybrid Physics Simulation of Multi-Fingered Hands for Dexterous In-Hand Manipulation Authors: Hendrich, Norman; Scharfe, Hanno; Zhang, Jianwei
    Dextrous object manipulation with multi-fingered robot hands remains one of the key challenges of service robotics. So far, most theoretical approaches and simulators have concentrated on the search for and evaluation of static stable grasps, but with neither a model of the full hand-arm system nor the system dynamics. GraspIt! is probably the bestknown simulator of this kind. In this work we present a simulator that uses the JBullet physics engine to realistically model grasps with multi-fingered hands. It supports manipulation tasks based on a complete arm and hand system, with full calculation of hand and object dynamics. A hybrid dynamics and kinematics approach avoids the oscillations introduced by the different size scale of the arm and hand, so that force-closure grasps are possible in addition to form-closure grasps. The software includes detailed models of our 24-DOF Shadow Dextrous hand and the 6-DOF Mitsubishi PA-10 robot arm. A real-time interface allows us to prepare or to replay and analyze grasp experiments performed on our real robots.
  • Search-Based Planning for Dual-Arm Manipulation with Upright Orientation Constraints Authors: Cohen, Benjamin; Chitta, Sachin; Likhachev, Maxim
    Dual-arm manipulation is an increasingly important skill for robots operating in home, retail and industrial environments. Dual-arm manipulation is especially essential for tasks involving large objects which are harder to grasp and manipulate using a single arm. In this work, we address dual-arm manipulation of objects in indoor environments. We are particularly focused on tasks that involve an upright orientation constraint on the grasped object. Such constraints are often present in human environments, e.g. when manipulating a tray of food or a container with fluids. In this paper, we present a search-based approach that is capable of planning dual-arm motions, often within one second, in cluttered environments while adhering to the orientation constraints. Our approach systematically constructs a graph in task space and generates motions that are consistent across runs with similar start/goal configurations and are low-cost. These motions come with guarantees on completeness and bounds on the suboptimality with respect to the graph that encodes the planning problem. For many problems, the consistency of the generated motions is important as it helps make the actions of the robot more predictable for a human interacting with the robot.
  • Generalizing Grasps across Partly Similar Objects Authors: Detry, Renaud; Ek, Carl Henrik; Madry, Marianna; Piater, Justus; Kragic, Danica
    The paper starts by reviewing the challenges associated to grasp planning, and previous work on robot grasping. Our review emphasizes the importance of agents that generalize grasping strategies across objects, and that are able to transfer these strategies to novel objects. In the rest of the paper, we then devise a novel approach to the grasp transfer problem, where generalization is achieved by <i>learning</i>, from a set of grasp examples, a dictionary of object parts by which objects are often grasped. We detail the application of dimensionality reduction and unsupervised clustering algorithms to the end of identifying the size and shape of parts that often predict the application of a grasp. The learned dictionary allows our agent to grasp novel objects which share a part with previously seen objects, by matching the learned parts to the current view of the new object, and selecting the grasp associated to the best-fitting part. We present and discuss a proof-of-concept experiment in which a dictionary is learned from a set of synthetic grasp examples. While prior work in this area focused primarily on shape analysis (parts identified, e.g., through visual clustering, or salient structure analysis), the key aspect of this work is the emergence of parts from <i>both</i> object shape <i>and</i> grasp examples. As a result, parts intrinsically encode the intention of executing a grasp.
  • A Grasp Strategy with the Geometric Centroid of a Groped Object Shape Derived from Contact Spots Authors: Bae, Ji-Hun; Park, Sung-Woo; Kim, Doik
    This paper proposes a strategy for grasp and manipulation of unknown objects. In order to derive force relations of fingers, the groped shape of soft fingers is introduced. The groped shape is not equal to the real object shape, but is tightly related to the force equilibrium of fingers. By considering contact forces of the groped shape, a simple control parameters can be derived. The manipulation of an object is easily accomplished by embedding the concept of virtual centroid into the grasp control to redistribute internal forces. With these concepts, an object can be easily translated, rotated, and manipulated by relocating fingers. The proposed method is verified with experiments.
  • The Application of Particle Filtering to Grasping Acquisition with Visual Occlusion and Tactile Sensing Authors: Zhang, Li; Trinkle, Jeff
    Advanced grasp control algorithms could benefit greatly from accurate tracking of the object as well as an accurate all-around knowledge of the system when the robot attempts a grasp. This motivates our study of the G-SL(AM)2 problem, in which two goals are simultaneously pursued: object tracking relative to the hand and estimation of parameters of the dynamic model. We view the G-SL(AM)2 problem as a filtering problem. Because of stick-slip friction and collisions between the object and hand, suitable dynamic models exhibit strong nonlinearities and jump discontinuities. This fact makes Kalman filters (which assume linearity) and extended Kalman filters (which assume differentiability) inapplicable, and leads us to develop a particle filter. An important practical problem that arises during grasping is occlusion of the view of the object by the robot’s hand. To combat the resulting loss of visual tracking fidelity, we designed a particle filter that incorporates tactile sensor data. The filter is evaluated off-line with data gathered in advance from grasp acquisition experiments conducted with a planar test rig. The results show that our particle filter performs quite well, especially during periods of visual occlusion, in which it is much better than the same filter without tactile data.