UTS RoboCup@Home Social Robot Team
2019 World Champions
The University of Technology Sydney took first place in the Social Robotics League at RoboCup 2019!
Social robots interact and help people in a home environment. UTS Unleashed! Team designs and develops innovative software on Pepper Robots.Social Robots are a disruptive innovation poised to change lives and transform business and society. The University of Technology Sydney (UTS) is a world leader in Social Robotics research and deployment in industry and business. UTS researchers, graduate students, and undergraduate students work with industry and government partners on applications of social robotics.
RoboCup@Home lets us explore technologies for human-robot interaction and sensors for voice interaction and image recognition. In order to provide useful services at home, the team develops social behaviours and foundational skills that allow robots to see, hear, follow and talk to people using fluent multimodal robot-human communication, language, lights, sound, and gestures.Social Robots are a disruptive innovation poised to change lives and transform business and society. The University of Technology Sydney (UTS) is a world leader in Social Robotics research and deployment in industry and business. UTS researchers, graduate students, and undergraduate students work with industry and government partners on applications of social robotics.
UTS Unleashed! won the Human-Robot Interface Award and came second in the competition overall.
UTS Unleashed! was the only Australian Team to qualify for the 2017 RoboCup@Home Social Robotics competition in Nagoya, Japan. More than 130,000 people attended RoboCup 2017.
RoboCup 2019 was held at the International Conference Centre at Darling Harbour in July 2019. UTS took First Place.
UTS Unleashed! RoboCup 2019 Qualification Video
The UTS RoboCup team would like to thank our amazing new sponsor WiseTech Global - an innovative global developer of cloud-based software solutions for the international and domestic logistics industries. Since 1994 WiseTech Global has helped logistics companies efficiently manage the movement of goods and information. With over 12,000 logistics organizations using WiseTech Global software across 130 countries, their breakthrough solutions are designed to deliver powerful productivity, extensive functionality, comprehensive integration, and deep compliance capabilities.
Why UTS created a new RoboCup Team
UTS is engaging in the RoboCup@Home Standard Social Platform competition for several key reasons:
- to engage with a global strategic scientific effort that seeks to make safe and intelligent AI and social robots a reality.
- to make major scientific contributions to the rapidly advancing field of AI and social robotics,
- to build National capability in AI and Social Robotics, an emerging disruptive technology, that will impact every Australian industry, and
- to provide transformational leadership opportunities and transdisciplinary practice-based learning experiences for UTS students.
UTS students will have the opportunity to:
- lead the design and development of an innovative transdisciplinary AI and social robot software system in collaboration with an industry partner, Softbank Robotics.
- engage in discovery and transdisciplinary research and innovation.
- experiment, test, evaluate and reflect on their transdisciplinary solutions using benchmark challenges at an international competition.
- benchmark their work with other students from world leading international universities.
- contribute to an aspirational international movement designed to shift the AI and social robotics frontier and advance the field of robotics to change peoples lives and transform business and society.
- develop new and transformational capabilities and skills for students: in designing an entirely new AI system for a law-abiding social robot that must interact with people safely and effectively while facing challenges in a home scenario requires sophisticated transdisciplinary creativity. Some examples include the following::
- AI and predictive real-time data analytics: robots are essentially big data analytics systems: using predictive data analytics to build models for real-time decisions making with copious volumes of complex unstructured data in multiple forms collected through their distributed sensors.
- designing an entirely new system for a law-abiding social robot that must interact with people safely and effectively while facing challenges in a home scenario requires sophisticated transdisciplinary creativity.
- design thinking and innovation: designing an entirely new system for a law-abiding social robot that must interact with people safely and effectively while facing challenges in a home scenario requires sophisticated transdisciplinary creativity.
- transdisciplinary design and complex problem solving: designing social robot behaviours using AI requires a rich transdisciplinary mindset. Researchers and students from different disciplines including Law, Health, Business, Psychology, Cognitive Science, Computer Science and Engineering, work jointly to create a new understanding of social robots in business and society.
- collaboration: we work as a team focused on the challenging practical problem of designing and developing an integrated social robot so students learn to be accountable and adaptable, how to build trust, negotiate, and persuade.
- leadership and entrepreneurship: every team member is expected to lead; to be strategic and entrepreneurial; to inspire other team members to develop high levels of confidence enabling high-orbit innovation and impact.
- contribute to understanding the societal impact and the need to shape policy around AI and Social Robots.
UTS Undergraduate Students
- Daniel Ebrahimian: UTS Engineering student and Robotics Software Leader. Daniel as also a member of the 2017 ATN project team involving a partnership with Commonwealth Bank. Daniels works on the architecture of our social robot system.
- Su Leong: UTS Engineering Student and Robotics Software Leader. Su works on several aspects of our AI and social robotics system and leads development on navigation.
- Bethany Lu: UTS Engineering Student focusing on Human-Robot Interaction.
- Thomas MacKenzie: Bachelor of Business student working on the disruptive innovation aspects of social robotics. Tom participated in the Robot Personality Design Hackathon and organises human-robot interaction experiments.
- Sophie Phillips: Bachelor of Creative Intelligence and Bachelor of Business student working on the disruptive innovation aspects of social robotics. Sophie participated in the Robot Personality Design Hackathon, organises human-robot interaction experiments and also working with CBA on a Social Robotics Project.
- Katie Powell: UTS Engineering Student focusing on Human-Robot Interaction.
- Ishan Sawant: UTS Engineering Student focusing on new applications for social robots in a family home.
- Christine Vinaviles: UTS Engineering Student focusing on using social robots to teach humans.
- The Duc Vu: UTS Engineering Student and Robotics Software Leader focusing on Human-Robot Interaction.
Postgraduate Coursework Student Researchers
- Qijun Wang: UTS Engineering postgraduate coursework student.
- Tran Nhut Le: UTS Engineering postgraduate coursework student.
- Tian Sang: UTS Engineering postgraduate Masters student.
UTS PhD Student Researchers
- Sidra Alam: PhD student investigating the role of robots as colleagues in the workplace. She is particularly interested in the topic of robot persuasion.
- Nik Dawson: PhD Student working on the impact of AI and Robotics on the labour market and jobs. Nik recently undertook an internship at the United Nations in Geneva.
- Siva Leela Krishna Chand Gudi: PhD student developing innovative solutions for Social Robotics. Before joining UTS, he worked for various research organizations including the Indian Space Research Organization (ISRO), Defence Research and Development Organization (DRDO), Indian Railways and Bharat Sanchar Nigam Limited (BSNL).
- Sarita Herse: PhD student investigating the psychological aspects of Human-Robot Interaction with a particular focus on the topic of "trust".
- Le Kang completed his First Class Honours degree in computer science in the Magic Lab 2016 gaining a Social Robotics internship with Stockland. He commenced his PhD in 2017 to focus on Human-Robot Engagement focusing on HRI via Pepper's display.
- Sammy Pfeiffer: Senior software engineer and PhD student who developed software on the humanoid robots at PAL Robotics. Team leader of PAL Robotics Robocup@Home in 2014 and the key member of the two previous Robocup@Home editions. Also conducted several @Home demonstrations at RoboCup competitions and is a member of the RoboCup SSPL Technical Committee.
- Suman Ojha: PhD student exploring the topic of robot emotional processing and its relationships with ethical decision making.
- Syed Ali Raza: PhD student working on deep reinforcement learning. Ali is a founding member of the Karachi Koalas and has led the development of two RoboCup 3D Simulation Teams.
- Meg Tonkin, PhD student focusing on user experience. Meg recently won the 2016 Best Robot Design Prize at the International Social Robotics Competition.
- Professor Mary-Anne Williams [Team Leader]: Mary-Anne is Director of the Magic Lab, Australia's leading social robotics lab. Mary-Anne has been Team Leader of more than 10 internationally competitive RoboCup teams since 2002. She serves on the Editorial Board for the International Journal of Social Robots; program committee for International Conference on Social Robotics and International Conference on Human-Robot Interaction; was Conference Chair, International Conference on Social Robotics 2014; served as Judge for RoboCup@Home Open Challenge; and serves on the ACM Eugene L. Lawler Award for Humanitarian Contributions within Computer Science and Informatics.
- Dr Benjamin Johnston: Deputy Director, Magic Lab, and Team Software Leader. University Medalist, Chancellor's Postdoctoral Fellow and winner of the 2010 Ray Kurzweil Prize for the most creative idea in AI. Key member and software development lead for two RoboCup teams. Program Chair of the International Conference on Social Robotics 2014.
- Dr Richard Billingsley: Senior Research Associate with expertise in Deep Learning and Robotics.
- Jesse Clark: Team Analytics Leader, Senior Researcher and Software Engineer who spent 7 years at NASA leading the development of highly sophisticated systems including data management systems for the International Space Station.
- Professor Pavlos Peppas: focuses on Knowledge Representation and Reasoning, and the integration of Machine Learning.
- Dr Jonathan Vitale: Research Fellow focusing on human social cognition, with a particular interest in developing models inspired by embodied cognition theories for robots. His research interests cover face perception and processing, attention and executive functioning, models of emotional interactions between humans and robots, Theory of Mind, and psychological effects of Human-Robot Interaction.
- Distinguished Professor Steve Wozniak, co-founder to Apple.
Many other UTS students have had the opportunity to join our Social Robotics Hackathons, and several other UTS students will join the team on our exciting journey to RoboCup 2019 and beyond....
- Neil McLaren: is the team's senior project manager. He ensured researchers and students performed at their peak for the duration of the project 2017-2019. Neil is a highly experienced IT manager with life-long and senior experience in the financial services industry.
- Srinivas.Madhisetty: is the team's photographer and key supporter. Sri is a professional photographer with main years experience. He has documented the team's journey in photos and video since 2017.
- Teraesa Ashworth: our generous naive user in 2019 and long-time friend of the team since 2003.
- Grainne Murphy: Faculty marketing and media support. Grainne is a highly experienced super engaged marketing manager 2017-2019.
- Margot Kopel: School of Computer Science Manager. Margot supported the team's operations in every way possible 2017-2019.
Scientific approaches and achievements include:
- Social Human-Robot Interaction: Robot pointing; Robot-human collaboration; Human-robot affordance; Motion and gesture learning; Robot learning by human demonstration.
- Social Robots from Research Lab and into the Wild: We work closely with our industry partners. Our social robot systems have been released in the wild at the Commonwealth Bank Innovation Lab in Sydney and several Stockland Shopping Malls. You can download the mobile app, NSW Government Innov8, that lets you see Gutsy dancing in virtual reality, more than 3000 people engaged with Gusty in virtual reality at the Sydney Royal Easter Show in 2016.
- Novel Algorithms for Social Autonomous Mobile Robots: Navigation with glass walls; PR2 Inverse Kinematics Engine; people tracker for mobile social robots.
- Novel Intelligent Social Robot Maneuvers: Robot soccer dodge; robot soccer dribble; robot soccer passing; robot soccer collaborative localisation using the ball; robot soccer strategy using case-based reasoning.
- Pioneering approaches and implementations of Belief Revision for Intelligent Robots: VADER, SATAN and ADS.
- Innovative Attention based Cognitive Architecture for Social Robots: ASMO, the ABC Architecture.
- Innovative Social Robot Programming Paradigms: PyRIDE, SIMKIT, JoyRIDE
- Innovative Commonsense Reasoning Framework: COMIRIT.
Sample videos that highlight the skills of UTS Unleashed!
UTS has developed novel and innovative systems for a range of social robots. UTS is home to Australia's only Personal Robot 2 (PR2), GUTSY, one of the world's leading social robots. We are key members of the PR2 Research Community, which includes Stanford University, University of California at Berkeley, MIT, Brown, Carnegie Mellon University, Cornell University, University of Texas, Georgia Tech, University of Washington, University of British Columbia, University of Tokyo, Chinese Academy of Sciences, KU Leuven, Samsung, BMCE Bank, and Bosch. In addition, we work closely with industry partners in Australia, e.g. the Commonwealth Bank of Australia. We also advise the government on innovation and entrepreneurship.
This social robotics video received the Most Entertaining Autonomous Robotics Video Award at the International Joint Conference on AI 2013.
Social robots dancing with humans. It turns out that dancing is a sophisticated human cognitive capability just like human language.
GUTSY using our our world first open source reverse kinematic engine to copy any motion. In this case, handwriting that demonstrates screen-to-hand coordination.
GUTSY is the first PR2 robot to be able to understand human language using IBM Watson technology.
We developed the UTS Unleashed! PyRIDE system to advance social robot rapid prototyping capabilities to help students accelerating learning.
UTS Social Robot System running on the Pepper robot during an invited visit to the University of Tokyo, December 2015.
GUTSY, Australia's only PR2 Robot, making coffee - a proof of concept, answering the question "Can Gutsy make coffee".
GUTSY is the first PR2 robot to be able to use Google Home technology to perform voice commands.
GUTSY using virtual reality! Another world first!
Moving around a modern building and developing social protocols for interacting with people in and around elevators is one of our research use cases.
UTS Unleashed! developed one of the most powerful kicks in the RoboCup SPL soccer league. The Ninja Kick can be used to score from anywhere on the field.
UTS Unleashed! developed the first Dodge in the Legged League to develop a dodge. The video contains the first dodge ever executed by UTS in a match against CArnegie Mellon (CMU). The CMU goalie makes a great clearing kick and a great save.
Human to PR2 Robot Motion Imitation and Recall System. Developed by 4th Year UTS student Michelle Yousseff.
A public performance of the UTS Song and Dance. To dance is human, to sing and dance is divine.
The Karach Koalas are a highly successful RoboCup 3D simulation team and a joint venture between UTS and IBA. This video was prepared just before RoboCup 2014. It shows clips from games with the University of Texas at Austin, University of Paris and Oxford University.
On the left is a video of the first ever robot dodge in the legged league. UTS used this manouver in a game with CMU at RoboCup 2004.
Previous participation in RoboCup
UTS has led numerous highly innovative and competitive RoboCup teams to championships since 2003 across four RoboCup leagues: Special Platform Soccer (AIBO and NAO robot leagues), 3D Soccer Simulation, Robot Rescue, and RoboCup@Home.
The team name UTS Unleashed! was originally inspired by our first robot, the puppy-like Sony AIBO robot that we used to play soccer at RoboCup 2003. UTS Unleashed! evolved to encapsulate our vision for intelligent, autonomous, proactive, social, and untethered robots designed to enrich people's lives.
1. RoboCup@Home Social Special Platform
Team: UTS Unleashed! competed at RoboCup 2017. The team won the Human-Robot Interface Award and gained second place in the competition.
2. RoboCup Soccer
Team: UTS Unleashed! competed at RoboCup 2003, 2004 and 2010 using AIBO and NAO Humanoid robots. This team was the top team in 2004 and the Australian Robot Soccer Champions. It holds the record for scoring the most goals in a game 16-0 at RoboCup 2004.
Team: WrightEagle Unleashed! was established in 2008 as a result of a joint venture between UTS and the prestigious University of Science and Technology of China (USTC). It was the first team that not only spanned two countries but two continents. USTC developed China's first computer and is the only University founded and managed by the Chinese Academy of Science. It has been consistently ranked as the top University in China by Nature Index NPI 2012 - 2014. The team defied all odds and were Runners-Up in 2008.
Team:NuBOTS Mary-Anne established this team in 2001 at the University of Newcastle while in the Faculty of Business and Law in close collaboration with colleagues and students in the Faculty of Engineering. She was the Team Leader at RoboCup 2002. This team took 3rd place in both the Soccer Matches and the Scientific Challenges, the best performance of any new team.
3. RoboCup Soccer 3D Simulation
Team: Karachi Koalas was established in 2010 as a result of joint venture with the prestigious Institute of Business Administration (IBA) in Karachi. IBA was established by the Wharton Business School, University of Pennsylvania. The team qualified for the International Robot Soccer World Cup in 2010, came 16th in 2011, 10th in 2012, and 5th in 2013. This team consistently defeated the University of Oxford and the University of Paris.
4. RoboCup@Home Open League
Team: REEM@LASALLE (PAL Robotics Team led by Sammy Pfeiffer) 2014. The UTS team RobotAssist competed at several RoboCup@Home championships.
5. RoboCup Rescue
UTS been a contributor to RoboCup Rescue and competed several occasions.