Publications
Publications by categories in reverse chronological order.
Conference Articles
2024
-
Design and Characterisation of Particle Jamming-Based Variable Stiffness Displays using Non-pneumatic ActuatorsJoshua Brown, and Fernando BelloIn IEEE Haptics Symposium, HAPTICS , Apr 2024This paper recieved an Honorable Mention for the best conference paper award at the IEEE Haptics Symposium 2020
Particle jamming is an emergent technology widely used to create haptic devices that can change their physical stiffness to render hard or soft surfaces. Conventional implementations of particle jamming-based interfaces have relied on bulky and expensive vacuum systems to force the particles together. This paper presents designs for two alternative, mechatronic approaches to activating a particle jamming-based haptic interface. Each design is subjected to a battery of mechanical tests to evaluate the range and uniformity of the achievable hardness change and response time. Results are presented and the effectiveness of these designs is considered against established pneumatic approaches.
@inproceedings{Brown2024_nonpneumatic_jamming, author = {Brown, Joshua and Bello, Fernando}, city = {Long Beach}, doi = {10.1109/HAPTICS59260.2024.10520854}, isbn = {979-8-3503-4511-7}, issn = {2324-7355}, booktitle = {IEEE Haptics Symposium, HAPTICS}, month = apr, pages = {379-384}, publisher = {IEEE}, title = {Design and Characterisation of Particle Jamming-Based Variable Stiffness Displays using Non-pneumatic Actuators}, volume = {2024-April}, year = {2024}, } -
Design and Implementation of a Polar-type 3D Printer for Highly Optimised Manufacturing of Prosthetic Sockets in LMICsJoshua Brown, Angus B. Clark , and Bukeikhan OmaraliIn Hamlyn Symposium on Medical Robotics (HSMR) , Jun 2024@inproceedings{Brown2024_POLAR, author = {Brown, Joshua and Clark, Angus B. and Omarali, Bukeikhan}, city = {London}, booktitle = {Hamlyn Symposium on Medical Robotics (HSMR)}, month = jun, publisher = {Imperial College London}, title = {Design and Implementation of a Polar-type 3D Printer for Highly Optimised Manufacturing of Prosthetic Sockets in LMICs}, volume = {2024-June}, year = {2024}, doi = {10.31256/HSMR2024.62}, } -
Dermaphone: Using Photogrammetry-based Data Driven Vibrotactile Texture Rendering to Simulate Skin Lesions for Dermatology Students using a SmartphoneAleera Ewan , Haya Alani , and Joshua BrownIn EuroHaptics 2024 WIP session , Jun 2024The Dermaphone is an educational tool for medical students learning dermatology. Within the application, consultants can use photogrammetry to create 3D models of skin lesions. These are presented to students with texture rendered through vibration by the iPhone’s taptic engine. The application is designed to give medical students exposure to dermatology and act as a study resource to fill gaps from their limited opportunities for practical experience. A framework for crowdsourcing a skin lesion library of 3D models and associated texture data is also provided, built as more educators contribute scans from real life cases.
@inproceedings{Ewan2024DermaphoneWIP, title = {Dermaphone: Using Photogrammetry-based Data Driven Vibrotactile Texture Rendering to Simulate Skin Lesions for Dermatology Students using a Smartphone}, year = {2024}, author = {Ewan, Aleera and Alani, Haya and Brown, Joshua}, booktitle = {EuroHaptics 2024 WIP session}, publisher = {Zenodo}, month = jun, doi = {10.5281/zenodo.12548842}, url = {https://doi.org/10.5281/zenodo.12548842}, }
2022
-
Using Audio Recordings to Characterise a Soft Haptic JoystickJoshua Brown, and Ildar FarkhatdinovIn Haptics and Audio Interaction Design (HAID) , Jun 2022The principle of particle jamming, a physical effect where fluids can be made to change their hardness at will, has many applications in engineering. Previous research has investigated combining this change of hardness with other haptic effects, resulting in a technology that can render vibration, hardness/softness and shape. This paper proceeds to describe the application of this technology to a soft haptic joystick handle for use in interactive games and telerobotics scenarios. Dynamically generated sound waveforms are used to drive vibrations inside the handle, and a microphone records these as they reach the tip of the handle under different jamming conditions. Audio frequency analysis is then used to analyse the behaviour of the resulting vibrations. This analysis shows that vibration is lowest under a strong vacuum, confirming previous observations that increasing the hardness of the particle fluid has the effect of restricting the displacement of the source vibrations. Moreover, frequency of vibration remained broadly stable in both hard and soft states again confirming previous observations. These results, obtained with a fundamentally different haptic device and sound-based instrumentation, necessitate the conclusion that the behaviour of particle jamming controlled vibration is repeatable and controllable regardless of the physical configuration in which it is used.
@inproceedings{Brown2022, author = {Brown, Joshua and Farkhatdinov, Ildar}, doi = {10.1007/978-3-031-15019-7_10/COVER}, isbn = {9783031150180}, issn = {16113349}, booktitle = {Haptics and Audio Interaction Design (HAID)}, keywords = {Particle jamming,Soft haptics,Vibration}, pages = {102-111}, publisher = {Springer Science and Business Media Deutschland GmbH}, title = {Using Audio Recordings to Characterise a Soft Haptic Joystick}, volume = {13417 LNCS}, year = {2022}, }
2021
-
A Soft, Vibrotactile, Shape-Changing Joystick for TeleroboticsJoshua Brown, and Ildar FarkhatdinovIn 2021 IEEE World Haptics Conference, WHC 2021 , Jun 2021This extended abstract describes the design of a haptic interface based on a joystick to provide vibrotactile, shape-changing and hardness/softness based feedback to the operators of remote mobile robots.
@inproceedings{Brown2021WHCJoystick, author = {Brown, Joshua and Farkhatdinov, Ildar}, doi = {10.1109/WHC49131.2021.9517163}, isbn = {9781665418713}, booktitle = {2021 IEEE World Haptics Conference, WHC 2021}, pages = {1158}, title = {A Soft, Vibrotactile, Shape-Changing Joystick for Telerobotics}, year = {2021}, } -
Shape-Changing Touch Pad based on Particle Jamming and VibrationJoshua Brown, and Ildar FarkhatdinovIn 2021 IEEE World Haptics Conference, WHC 2021 , Jun 2021This extended abstract describes the design of a haptic interface based on particle jamming and a pair of vibration actuators for simultaneous rendering of vibration, shape and softness/hardness sensations.
@inproceedings{Brown2021WHCTouchpad, author = {Brown, Joshua and Farkhatdinov, Ildar}, doi = {10.1109/WHC49131.2021.9517168}, isbn = {9781665418713}, booktitle = {2021 IEEE World Haptics Conference, WHC 2021}, pages = {337}, title = {Shape-Changing Touch Pad based on Particle Jamming and Vibration}, year = {2021}, } -
Towards a Portable, Affordable Tactile DisplayJoshua Brown, Xin Zhou , James Mardell , and 1 more authorIn 2021 IEEE World Haptics Conference, WHC 2021 , Jun 2021This work-in-progress project describes the evolution of a design for a small form factor, affordable tactile display using simple, easily obtainable motors and mechanical linkages. Performance characteristics of each display are given, as are plans for experimental validation of their potential to support visually impaired smartphone users.
@inproceedings{Brown2021WHCMouse, author = {Brown, Joshua and Zhou, Xin and Mardell, James and Witkowski, Mark}, doi = {10.1109/WHC49131.2021.9517166}, isbn = {9781665418713}, booktitle = {2021 IEEE World Haptics Conference, WHC 2021}, pages = {1152}, title = {Towards a Portable, Affordable Tactile Display}, year = {2021}, } -
Using RoboChick to Identify the Behavioral Features Promoting Social InteractionsZuzanna Slonina , Aramis Augusto Bonzini , Joshua Brown, and 5 more authorsIn 2021 IEEE International Conference on Development and Learning (ICDL) , Jun 2021Studies of social behaviors in animals are faced with various methodological difficulties, which can be addressed by using controlled artificial social agents. Previous studies have shown that various animal species interact with passive replicas or interactive robots that mimic their conspecifics. In the case of chickens, filial attachment (imprinting) to robots is observed in young chicks. However, the features and functions of the robots that maximize the efficiency of chicken-robot attachment have not yet been identified. Therefore, we designed RoboChick, a simple robot that can be easily customized with different features. Further, we developed a protocol for assessing the attractiveness of each feature. In the current study, we tested the attractiveness of two RoboChick features during robot-chick interactions: the presence of flashing lights and vocalizations in response to chick interactions. Our proposed protocol proved suitable for assessing the efficacy of the features. RoboChick, which is open and modular, can be easily reproduced by other research groups and adapted to test different features in different experimental conditions.
@inproceedings{Slonina2021_RoboChick, author = {Slonina, Zuzanna and Bonzini, Aramis Augusto and Brown, Joshua and Wang, Shuge and Farkhatdinov, Ildar and Althoefer, Kaspar and Jamone, Lorenzo and Versace, Elisabetta}, booktitle = {2021 IEEE International Conference on Development and Learning (ICDL)}, title = {Using RoboChick to Identify the Behavioral Features Promoting Social Interactions}, year = {2021}, pages = {1-6}, keywords = {Protocols;Animals;Conferences;Tools;Manufacturing;Robots}, doi = {10.1109/ICDL49984.2021.9515641}, }
2020
-
Soft Haptic Interface based on Vibration and Particle JammingJoshua Brown, and Ildar FarkhatdinovIn IEEE Haptics Symposium, HAPTICS , Mar 2020This paper was a finalist for the best conference paper award at the IEEE Haptics Symposium 2020
Whilst common in devices ranging from smart-phones to game controllers, vibrotactile feedback has generally been limited to providing a uniform sensation across a tactile surface. We propose a haptic interface based on the emerging physical effect of particle jamming with both vibrotactile and shape changing outputs, which can be extended in space to create haptic surfaces and devices with shape and vibrotactile responses localised to one part of the device. This paper gives an overview of the physical principles behind this technology and presents detailed performance metrics obtained from a working prototype. These include experimental characterization of the relationships between air pressure and electric motor power and vibration amplitude and frequency which show that it is possible to control vibrotactile amplitude and frequency independently.
@inproceedings{Brown2020_Soft_Haptic_Interface_Based_On_Vibration, author = {Brown, Joshua and Farkhatdinov, Ildar}, city = {Washington DC}, doi = {10.1109/HAPTICS45997.2020.ras.HAP20.8.0698f2bb}, isbn = {9781728102344}, issn = {23247355}, booktitle = {IEEE Haptics Symposium, HAPTICS}, month = mar, pages = {1-6}, publisher = {IEEE}, title = {Soft Haptic Interface based on Vibration and Particle Jamming}, volume = {2020-March}, year = {2020}, }
2017
-
The Role of Perspective Cues in RSVPJoshua Brown, Mark Witkowski, James Mardell , and 2 more authorsIn 2017 21st International Conference Information Visualisation (IV) , Jul 2017Riffling the pages of a book, perhaps in the search for a specific image, is an example of Rapid Serial Visual Presentation (RSVP). Even at a pace of 10 images per second, successful search is often possible. Interest in RSVP arises because a digital embodiment of RSVP has many applications. There are many possible ’modes’ of RSVP. However, a mode can be especially helpful if, after the appearance of an image, and without delaying the arrival of other images, it can remain in view for a second or two to allow a user to confirm that a desired image has been found. Moreover, if a collection of images is presented in such a way as to be perceived as moving in 3D space, it is thought that the search for an individual image can thereby be enhanced by comparison with a 2D presentation. To test this conjecture we devise and use the "Deep-Flat" visual illusion whereby a column of moving images magnifying in size is perceived as approaching the viewer as in a 3D space. When the images are presented in an equivalent way horizontally as a row, the viewer tends to see this as images growing in size, but now on a flat (2D) plane. We tested comparable RSVP designs in these two illusions to ascertain the relative effects of 2D and 3D style presentation under precisely controlled conditions. Elicited data included both performance measures (e.g., recognition success), and user preferences and opinions. We established the effectiveness of RSVP using the illusion. When tested under directly comparable conditions, we concluded that performance is not significantly affected by the illusion of depth, but that the inclusion of certain background cues can have a significantly detrimental effect on performance.
@inproceedings{Brown2017, author = {Brown, Joshua and Witkowski, Mark and Mardell, James and Wittenburg, Kent and Spence, Robert}, city = {London}, doi = {10.1109/iV.2017.52}, isbn = {978-1-5386-0831-9}, booktitle = {2017 21st International Conference Information Visualisation (IV)}, month = jul, pages = {29-34}, publisher = {IEEE}, title = {The Role of Perspective Cues in RSVP}, url = {http://ieeexplore.ieee.org/document/8107944/}, year = {2017}, }
Journal Articles
2024
-
Hardness Changing Tactile Displays for Simulating the Feel of Organic TissuesJoshua Brown, and Fernando BelloFrontiers in Robotics and AI, Aug 2024Physical interaction with patients, for example conducted as part of a diagnostic examination or surgical procedure, provides clinicians with a wealth of information about their condition. Simulating this interaction is of great interest to researchers in both haptics and medical education, and the development of softness changing tactile interfaces is important in recreating the feel of different soft tissues. This paper presents designs for a variety of novel electromechanical and electromagnetic mechanisms for controlling particle jamming-based, hardness changing tactile displays, intended to allow medical trainees to experience these physical interactions in a range of simulation settings such as clinical skills teaching laboratories. Each design is then subjected to a battery of mechanical tests to evaluate its effectiveness compared to the state of the art, as well as their suitability for simulating the physical hardness of different types of soft tissues, previously characterised in established literature. These results demonstrate that all of the technologies presented are able to exhibit a measurable hardness change, with Shore hardness values between 3A and 57A achieved by the most effective constriction-based device. The electromechanical devices based on constriction and compression, and the state-of-the-art pneumatic device, were able to achieve hardness changes within a range that is useful for replicating the softness of organic tissue. The electromechanical and electromagnetic devices were also found to effect their full range of hardness change in less than a second, compared to several seconds for the state-of-the-art. These results show that the performance of softness changing tactile displays can be improved with the electromechanical actuation techniques proposed in this paper, and that such displays are able to replicate the physical characteristics of soft tissues and may therefore be of benefit in medical training and simulation scenarios.
@article{Brown2024_OrganicJamming, author = {Brown, Joshua and Bello, Fernando}, title = {Hardness Changing Tactile Displays for Simulating the Feel of Organic Tissues}, volume = {11}, issn = {2296-9144}, url = {https://www.frontiersin.org/journals/robotics-and-ai/articles/10.3389/frobt.2024.1404543/abstract}, doi = {10.3389/frobt.2024.1404543}, journal = {Frontiers in Robotics and AI}, publisher = {Frontiers}, year = {2024}, month = aug, }
2023
-
3D printed decompression stent for the treatment of extensive odontogenic cystsJanhvi Shah , Hristina Cvetanovska , Joshua Brown, and 1 more authorBritish Journal of Oral and Maxillofacial Surgery, Dec 2023@article{Shah2023, title = {3D printed decompression stent for the treatment of extensive odontogenic cysts}, volume = {61}, issn = {0266-4356}, url = {http://dx.doi.org/10.1016/j.bjoms.2023.08.024}, doi = {10.1016/j.bjoms.2023.08.024}, number = {10}, journal = {British Journal of Oral and Maxillofacial Surgery}, publisher = {Elsevier BV}, author = {Shah, Janhvi and Cvetanovska, Hristina and Brown, Joshua and Cheng, Leo}, year = {2023}, month = dec, pages = {e9}, }
2022
-
Design, characterisation and validation of a haptic interface based on twisted string actuationValeria Skvortsova , Simeon Nedelchev , Joshua Brown, and 2 more authorsFrontiers in Robotics and AI, Dec 2022This paper presents the design and experimental characterisation of a wrist haptic interface based on a twisted string actuator. The interface is designed for controlled actuation of wrist flexion/extension and is capable of rendering torque feedback through a rotary handle driven by the twisted string actuator and spring-loaded cable mechanisms. The interface was characterised to obtain its static and dynamic haptic feedback rendering capabilities. Compliance in the spring and actuation mechanism makes the interface suitable for smooth rendering of haptic feedback of large magnitudes due to the high motion transmission ratio of the twisted strings. Haptic virtual wall rendering capabilities are demonstrated.
@article{10.3389/frobt.2022.977367, author = {Skvortsova, Valeria and Nedelchev, Simeon and Brown, Joshua and Farkhatdinov, Ildar and Gaponov, Igor}, title = {Design, characterisation and validation of a haptic interface based on twisted string actuation}, journal = {Frontiers in Robotics and AI}, volume = {9}, year = {2022}, doi = {10.3389/frobt.2022.977367}, issn = {2296-9144}, }
2021
-
Innovation in the time of SARS-CoV-2: A collaborative journey between NHS clinicians, engineers, academics and industryThe Surgeon, Dec 2021During the pandemic healthcare faced great pressure on the availability of protective equipment. This paper describes the entire novel innovative process of design optimisation, production and deployment of face-visors to NHS frontline workers during SARS-CoV-2 pandemic. The described innovative journey spans collaboration between clinicians and academic colleagues for design to the implementation with industry partners of a face-visor for use in a healthcare setting. It identifies the enablers and barriers to development along with the strategies employed to produce a certified reusable, adjustable, high volume and locally produced face-visor. The article also explores aspects of value, scalability, spread and sustainability all of which are essential features of innovation.
@article{DIN2021e281, title = {Innovation in the time of SARS-CoV-2: A collaborative journey between NHS clinicians, engineers, academics and industry}, journal = {The Surgeon}, volume = {19}, number = {5}, pages = {e281-e288}, year = {2021}, issn = {1479-666X}, doi = {https://doi.org/10.1016/j.surge.2020.12.008}, author = {Din, Ahmed Riaz and Althoefer, Kaspar and Farkhatdinov, Ildar and Brown, Joshua and Morgan, Claire and Shahdad, Shakeel}, keywords = {Innovation, Dentistry, Full-face visor, Engineering, 3D printing}, } -
A suite of robotic solutions for nuclear waste decommissioningIvan Vitanov , Ildar Farkhatdinov, Brice Denoun , and 13 more authorsRobotics, Dec 2021Editor’s Choice articles are based on recommendations by the scientific editors of MDPI journals and aim to provide a snapshot of some of the most exciting work published in the various research areas of the journal.
Dealing safely with nuclear waste is an imperative for the nuclear industry. Increasingly, robots are being developed to carry out complex tasks such as perceiving, grasping, cutting, and manipulating waste. Radioactive material can be sorted, and either stored safely or disposed of appropriately, entirely through the actions of remotely controlled robots. Radiological characterisation is also critical during the decommissioning of nuclear facilities. It involves the detection and labelling of radiation levels, waste materials, and contaminants, as well as determining other related parameters (e.g., thermal and chemical), with the data visualised as 3D scene models. This paper overviews work by researchers at the QMUL Centre for Advanced Robotics (ARQ), a partner in the UK EPSRC National Centre for Nuclear Robotics (NCNR), a consortium working on the development of radiation-hardened robots fit to handle nuclear waste. Three areas of nuclear-related research are covered here: human–robot interfaces for remote operations, sensor delivery, and intelligent robotic manipulation.
@article{Vitanov2021, author = {Vitanov, Ivan and Farkhatdinov, Ildar and Denoun, Brice and Palermo, Francesca and Otaran, Ata and Brown, Joshua and Omarali, Bukeikhan and Abrar, Taqi and Hansard, Miles and Oh, Changjae and Poslad, Stefan and Liu, Chen and Godaba, Hareesh and Zhang, Ketao and Jamone, Lorenzo and Althoefer, Kaspar}, doi = {10.3390/robotics10040112}, issn = {22186581}, issue = {4}, journal = {Robotics}, keywords = {Human–robot interaction,Inspection robots,Manipulators,Nuclear robots,Teleoperated robots,Vision and perception}, month = dec, publisher = {MDPI}, title = {A suite of robotic solutions for nuclear waste decommissioning}, volume = {10}, year = {2021}, }
Theses
2024
-
Using Particle Jamming to Create Soft Haptic Interfaces for use in TeleroboticsJoshua BrownDec 2024Haptic technology is no longer limited to rendering simple effects in game controllers and smartphones. Recent advances in the design of haptic devices have made important advances in both the rendering of high-definition haptic sensations and integrating haptic feedback into an ever expanding range of digital technologies. However, true high information density haptic interfaces still remain out of reach. This PhD project aims to make progress toward higher information-density haptic interfaces by layering multiple haptic effects on top of each other, such that they can be actuated independently. The project has both technical and scientific goals. The technical objective is to design, validate and utilize a novel soft technology based on particle jamming for rendering tactile hardness, vibration and shape change. The scientific goal is to use this technology to conduct empirical studies into how multiple haptic cues can be layered on top of one another, perceived and understood by a user. This thesis begins with an overview of the state of the art in haptic technology, followed by in depth reviews into aspects of soft haptics and applications of haptic feedback in telerobotics. A method for combining multiple haptic cues is then described and prototypes demonstrated and characterised. The technology is integrated into two interactive haptic interfaces and used in two scientific studies, one addressing the psychophysics of multi-modal haptic feedback, the other investigating applications of haptic feedback in a difficult robot teleoperation task.
@phdthesis{BrownPhDThesis, author = {Brown, Joshua}, title = {Using Particle Jamming to Create Soft Haptic Interfaces for use in Telerobotics}, year = {2024}, }
