%43%6f%6c%6c%65%67%65%20%6f%66%20%4c%69%62%65%72%61%6c%20%41%72%74%73
-
KAIST's Pioneering VR Precision Technology & Choreography Tool Receive Spotlights at CHI 2025
Accurate pointing in virtual spaces is essential for seamless interaction. If pointing is not precise, selecting the desired object becomes challenging, breaking user immersion and reducing overall experience quality. KAIST researchers have developed a technology that offers a vivid, lifelike experience in virtual space, alongside a new tool that assists choreographers throughout the creative process.
KAIST (President Kwang-Hyung Lee) announced on May 13th that a research team led by Professor Sang Ho Yoon of the Graduate School of Culture Technology, in collaboration with Professor Yang Zhang of the University of California, Los Angeles (UCLA), has developed the ‘T2IRay’ technology and the ‘ChoreoCraft’ platform, which enables choreographers to work more freely and creatively in virtual reality. These technologies received two Honorable Mention awards, recognizing the top 5% of papers, at CHI 2025*, the best international conference in the field of human-computer interaction, hosted by the Association for Computing Machinery (ACM) from April 25 to May 1.
< (From left) PhD candidates Jina Kim and Kyungeun Jung along with Master's candidate, Hyunyoung Han and Professor Sang Ho Yoon of KAIST Graduate School of Culture Technology and Professor Yang Zhang (top) of UCLA >
T2IRay: Enabling Virtual Input with Precision
T2IRay introduces a novel input method that allows for precise object pointing in virtual environments by expanding traditional thumb-to-index gestures. This approach overcomes previous limitations, such as interruptions or reduced accuracy due to changes in hand position or orientation.
The technology uses a local coordinate system based on finger relationships, ensuring continuous input even as hand positions shift. It accurately captures subtle thumb movements within this coordinate system, integrating natural head movements to allow fluid, intuitive control across a wide range.
< Figure 1. T2IRay framework utilizing the delicate movements of the thumb and index fingers for AR/VR pointing >
Professor Sang Ho Yoon explained, “T2IRay can significantly enhance the user experience in AR/VR by enabling smooth, stable control even when the user’s hands are in motion.”
This study, led by first author Jina Kim, was supported by the Excellent New Researcher Support Project of the National Research Foundation of Korea under the Ministry of Science and ICT, as well as the University ICT Research Center (ITRC) Support Project of the Institute of Information and Communications Technology Planning and Evaluation (IITP).
▴ Paper title: T2IRay: Design of Thumb-to-Index Based Indirect Pointing for Continuous and Robust AR/VR Input▴ Paper link: https://doi.org/10.1145/3706598.3713442
▴ T2IRay demo video: https://youtu.be/ElJlcJbkJPY
ChoreoCraft: Creativity Support through VR for Choreographers
In addition, Professor Yoon’s team developed ‘ChoreoCraft,’ a virtual reality tool designed to support choreographers by addressing the unique challenges they face, such as memorizing complex movements, overcoming creative blocks, and managing subjective feedback.
ChoreoCraft reduces reliance on memory by allowing choreographers to save and refine movements directly within a VR space, using a motion-capture avatar for real-time interaction. It also enhances creativity by suggesting movements that naturally fit with prior choreography and musical elements. Furthermore, the system provides quantitative feedback by analyzing kinematic factors like motion stability and engagement, helping choreographers make data-driven creative decisions.
< Figure 2. ChoreoCraft's approaches to encourage creative process >
Professor Yoon noted, “ChoreoCraft is a tool designed to address the core challenges faced by choreographers, enhancing both creativity and efficiency. In user tests with professional choreographers, it received high marks for its ability to spark creative ideas and provide valuable quantitative feedback.”
This research was conducted in collaboration with doctoral candidate Kyungeun Jung and master’s candidate Hyunyoung Han, alongside the Electronics and Telecommunications Research Institute (ETRI) and One Million Co., Ltd. (CEO Hye-rang Kim), with support from the Cultural and Arts Immersive Service Development Project by the Ministry of Culture, Sports and Tourism.
▴ Paper title: ChoreoCraft: In-situ Crafting of Choreography in Virtual Reality through Creativity Support Tools▴ Paper link: https://doi.org/10.1145/3706598.3714220
▴ ChoreoCraft demo video: https://youtu.be/Ms1fwiSBjjw
*CHI (Conference on Human Factors in Computing Systems): The premier international conference on human-computer interaction, organized by the ACM, was held this year from April 25 to May 1, 2025.
2025.05.13 View 11807 -
KAIST sends out Music and Bio-Signs of Professor Kwon Ji-yong, a.k.a. G-Dragon, into Space to Pulsate through Universe and Resonate among Stars
KAIST (President Kwang-Hyung Lee) announced on the 10th of April that it successfully promoted the world’s first ‘Space Sound Source Transmission Project’ based on media art at the KAIST Space Research Institute on April 9th through collaboration between Professor Jinjoon Lee of the Graduate School of Culture Technology, a world-renowned media artist, and the global K-Pop artist, G-Dragon.
This project was proposed as part of the ‘AI Entertech Research Center’ being promoted by KAIST and Galaxy Corporation. It is a project to transmit the message and sound of G-Dragon (real name, Kwon Ji-yong), a singer/song writer affiliated with Galaxy Corporation and a visiting professor in the Department of Mechanical Engineering at KAIST, to space for the first time in the world.
This is a convergence project that combines science, technology, art, and popular music, and is a new form of ‘space culture content’ experiment that connects KAIST’s cutting-edge space technology, Professor Jinjoon Lee’s media art work, and G-Dragon’s voice and sound source containing his latest digital single, "HOME SWEET HOME".
< Photo 1. Professor Jinjoon Lee's Open Your Eyes Project "Iris"'s imagery projected on the 13m space antenna at the Space Research Institute >
This collaboration was planned with the theme of ‘emotional signals that expand the inner universe of humans to the outer universe.’ The image of G-Dragon’s iris was augmented through AI as a window into soul symbolizing his uniqueness and identity, and the new song “Home Sweet Home” was combined as an audio message containing the vibration of that emotion.
This was actually transmitted into space using a next-generation small satellite developed by KAIST Space Research Institute, completing a symbolic performance in which an individual’s inner universe is transmitted to outer space.
Professor Jinjoon Lee’s cinematic media art work “Iris” was unveiled at the site. This work was screened in the world’s first projection mapping method* on KAIST Space Research Institute’s 13m space antenna. This video was created using generative artificial intelligence (AI) technology based on the image of G-Dragon's iris, and combined with sound using the data of the sounds of Emile Bell rings – the bell that holds a thousand years of history, it presented an emotional art experience that transcends time and space.
*Projection Mapping: A technology that projects light and images onto actual structures to create visual changes, and is a method of expression that artistically reinterprets space.
This work is one of the major research achievements of KAIST TX Lab and Professor Lee based on new media technology based on biometric data such as iris, heartbeat, and brain waves.
Professor Jinjoon Lee said, "The iris is a symbol that reflects inner emotions and identity, so much so that it is called the 'mirror of the soul,' and this work sought to express 'the infinite universe seen from the inside of humanity' through G-Dragon's gaze."
< Photo 2. (From left) Professor Jinjoon Lee of the Graduate School of Culture Technology and G-Dragon (Visiting Professor Kwon Ji-yong of the Department of Mechanical Engineering) >
He continued, "The universe is a realm of technology as well as a stage for imagination and emotion, and I look forward to an encounter with the unknown through a new attempt to speak of art in the language of science including AI and imagine science in the form of art." “G-Dragon’s voice and music have now begun their journey to space,” said Yong-ho Choi, Galaxy Corporation’s Chief Happiness Officer (CHO). “This project is an act of leaving music as a legacy for humanity, while also having an important meaning of attempting to communicate with space.” He added, “This is a pioneering step to introduce human culture to space, and it will remain as a monumental performance that opens a new chapter in the history of music comparable to the Beatles.”
Galaxy Corporation is leading the future entertainment technology industry through its collaboration with KAIST, and was recently selected as the only entertainment technology company in a private meeting with Microsoft CEO Nadella. In particular, it is promoting the globalization of AI entertainment technology, receiving praise as a “pioneer of imagination” for new forms of AI entertainment content, including the AI contents for the deceased.
< Photo 3. Photo of G-Dragon's Home Sweet Home being sent into the space via Professor Jinjoon Lee's Space Sound Source Transmission Project >
Through this project, KAIST Space Research Institute presented new possibilities for utilizing satellite technology, and showed a model for science to connect with society in a more popular way.
KAIST President Kwang-Hyung Lee said, “KAIST is a place that always supports new imaginations and challenges,” and added, “We will continue to strive to continue creative research that no one has ever thought of, like this project that combines science, technology, and art.”
In the meantime, Galaxy Corporation, the agency of G-Dragon’s Professor Kwon Ji-yong, is an AI entertainment company that presents a new paradigm based on IP, media, tech, and entertainment convergence technology.
2025.04.10 View 11689 -
KAIST Opens Newly Expanded Center for Contemplative Research in Collaboration with Brain and Cognitive Sciences Department
KAIST (represented by President Kwang Hyung Lee) announced on January 2nd that it would hold an opening ceremony for the expanded KAIST Center for Contemplative Research (Director Wan Doo Kim) at the Creativity Learning Building on its Daejeon campus on January 3 (Friday).
Established in 2018 with the mission of "integrating meditation and science for the happiness and prosperity of humanity," the KAIST Center for Contemplative Research has been expanding its scope of research into the neuroscience of meditation and training empathetic educators who will lead the field of meditation science in collaboration with the Brain and Cognitive Sciences Department, which was established in 2022.
Supported by the Plato Academy Foundation and with funding from SK Discovery for the facility’s expansion, the center now occupies an extended space on the 5th floor of the Creativity Learning Center. The new facilities include: ▲ Advanced Research Equipment ▲ Meditation Science Laboratories ▲ VR/XR-Based Meditation Experience Rooms ▲ A Large Digital Art Meditation Hall ▲ Personal Meditation Halls.
Particularly, the center plans to conduct next-generation meditation research using cutting-edge technologies such as: ▲ Brain-Computer Interface Technology ▲ Meditation Wearable Devices ▲ Metaverse-Based Meditation Environments.
The opening ceremony, scheduled for the morning of January 3 (Friday), was attended by key figures, including Plato Academy Foundation Chairman Chang-Won Choi, MindLab CEO Professor Seong-Taek Cho, Bosung Group Vice President Byung-Chul Lee, and KAIST President Kwang Hyung Lee.
The event began with a national moment of silence to honor the victims of the recent Jeju Air passenger accident. It included a progress report by the center director, a lecture by Professor Jaeseung Jeong, panel discussions, and more.
Following a tour of the expanded facilities, the center hosted a 20-minute hands-on meditation science session using *Looxid Labs EEG devices for the first 50 participants.
*Looxid Labs EEG Device: A real-time brainwave measurement device developed by KAIST startup Looxid Labs that enables users to experience efficient and AI-powered data-driven meditation science practice (Looxid Labs website: https://looxidlabs.com/).
During the ceremony, Director of the Center for Contemplative Research Wan Doo Kim presented on "The Mission, Vision, and Future of the KAIST Center for Contemplative Research." Yujin Lee, a combined master’s and doctoral researcher from the Brain and Cognitive Sciences Department, shared insights on "The Latest Trends in Meditation Science Research."
A panel discussion and Q&A session on "The Convergence of Meditation and Brain and Cognitive Sciences" followed featuring Professors Jaeseung Jeong, HyungDong Park (Brain and Cognitive Sciences), and Jiyoung Park (Digital Humanities and Social Sciences).
Director Wan Doo Kim commented, “With this expanded opening, we aim to offer advanced meditation programs integrating brain and cognitive sciences and cutting-edge technology not only to KAIST members but also to the general public interested in meditation. We will continue to dedicate ourselves to interdisciplinary research between meditation and science.”
2025.01.03 View 9331 -
The Relentless Rain: East Asia's Recent Floods and What Lies Beneath
In just a month's time, East Asia witnessed torrential downpours that would usually span an entire season. Japan, battered by three times its usual monthly rainfall, faced landslides and flooding that claimed over 200 lives. Meanwhile, South Korea grappled with its longest monsoon in seven years, leaving more than 40 individuals dead or missing. But these events, as harrowing as they sound, are more than just weather anomalies. They're telltale signs, symptoms of a larger malaise that has gripped our planet.
Diving deep into these rain-soaked mysteries, a recently published paper in the journal Science Advances offers a fresh perspective. Led by a research team at the Korea Advanced Institute of Science and Technology (KAIST), Korea, the research unpacks the influence of human-induced climate changes on the East Asia Summer Monsoon frontal system.
Heavy summer rain has a significant impact on agriculture and industry, and can be said to be one of the greatest threats to human society by causing disasters such as floods and landslides, affecting the local ecosystem. It has been reported from all over the world that the intensity of summer heavy rain has changed over the past few decades. However, summer rain in East Asia is caused by various forms such as typhoons, extratropical cyclones, and fronts, and efforts to study heavy frontal rain, which account for more than 40% of summer rainfall, is still insufficient. In addition, because heavy rain is also influenced by natural fluctuations or coincidences in the climate system, it is not yet known to what extent warming due to human activities affects the intensity of heavy frontal precipitation.
An international joint research team consisting of eight institutions from Korea, the United States, and Japan, including KAIST, Tokyo University, Tokyo Institute of Technology, Chonnam National University, GIST, and Utah State University, confirmed the intensity of heavy rain caused by the weather fronts in East Asia using observation data for the past 60 years and found that the coast of southeastern China. It was found that the intensity of heavy rain increased by about 17% across the Korean Peninsula and Japan. To investigate the cause of these changes, the research team used the Earth Metaverse experiment, which simulated Earth with and without greenhouse gas emissions due to human activities, and found that heavy rain intensity was strengthened by about 6% due to greenhouse gas emissions, and the changes discovered were has succeeded for the first time in the world in showing that warming cannot be explained without the effects of human activities.
< Figure 1. (Left) Observed difference in frontal rainfall intensity (FRI) from the later (1991–2015) to the earlier periods (1958–1982) (Right) Visualization of the impact of anthropogenic warming on the intensity of heavy frontal rain analyzed using the Earth Metaverse experiment. >
"It's not just about connecting the dots," said Moon, the first author of the paper, "it's about seeing the larger pattern. Our data analysis reveals a clear and intensified trend in East Asia's frontal rainfall, one that's intertwined with human actions and increasingly harmful for lives and property."
One of the intriguing finds from the study is the mechanics behind this intensification. The team found increased moisture transport due to a warmer climate, which, when coupled with the strengthening of a gigantic weather system called the West North Pacific Subtropical High, results in enhanced frontal rainfall. It’s akin to the climate dialing up the volume on rain events. As the atmosphere warms, it holds more moisture, leading to heavier downpours when conditions are right.
Nobuyuki Utsumi, another voice from the team, makes the science accessible for all, saying, "Monsoon rain isn't just rain anymore. The frequency, the intensity, it's changing. And our actions, our carbon footprint, are casting a larger shadow than we anticipated."
While the devastating news of floods fills headlines, Professor Simon Wang of Utah State University, reminds us of the underlying importance of their study. "It's like reading a detective novel. To solve the mystery of these floods, one has to trace them back to their roots. This work hints at a future where such intense rain events aren't the exception but might become an everyday reality."
Hyungjun Kim, the principal investigator of the team throws in a note of caution, "Understanding this is just the first step. Predicting and preparing for these extremes is the real challenge. Every amplified rainfall event is a message from the future, urging us to adapt." So far, predicting rainfall intensity and locations remains a challenging task for even the most sophisticated weather models.
< Figure 2. Comparison of rates of change in Anthropocene fingerprints. The horizontal axis shows the long-term change slope of the Anthropocene fingerprint signal (1958 to 2015). Shows the probability distribution of slopes extracted from the non-warming experiment (blue) and the warming experiment (red). The vertical solid lines are the slope of the Anthropocene fingerprint signal extracted from observational data. >
The researchers say, “Facing climate change, the narrative of this new study is more than mere numbers and data. It's a story of our planet, our actions, and the rain-soaked repercussions we're beginning to face. As we mop up the aftermath of another flood, research like Moon's beckons us to look deeper, understand better, and act wiser.”
< Figure 3. Comparison of water vapor convergence and rate of change of the western North Pacific high pressure. Shows the gradient of change in water vapor convergence (horizontal axis) and the Northwestern Pacific-East Asia pressure gradient (vertical axis) extracted from warming (red) and non-warming (blue) experiments. Shows the distribution of slope changes of the two indices during the period 1958 to 1982 (P1) and 1991 to 2015 (P2). >
The results of this study were published on November 24 in Science Advances. (Paper title: Anthropogenic warming induced intensification of summer monsoon frontal precipitation over East Asia)
This research was conducted with support from the National Research Foundation of Korea's Overseas Scientist Attraction Project (BP+) and the Anthropocene Research Center.
2023.12.05 View 10886 -
Prof. Austin Givens of KAIST Language Center receives Ministerial Commendation
< Professor Austin Givens posing with the Letter of Commendation by the Miniser Hwang-Keun Chung of the Ministry of Agriculture, Food and Rural Affairs at the Language Center >
Professor Austin Givens of our Language Center received a Ministerial Commendation from the Korean Ministry of Agriculture, Food and Rural Affairs dated December 21st, 2022 for his contribution for the development of the Korean Foodservices Industry through his active and prominent media presence.
Professor Austin Givens has been working with the KAIST Language Center since 2017, and has shown his passion for Korean food through his YouTube channel "Austin! Eating What is Given", introducing not only the food but also the culture of Korea and KAIST to his international viewers through the videos he shares of his candid reviews of the food and restaurants around town on the popular video streaming platform.
< Thumbnail introductions of Professor Givens' videos on his YouTube channel, "Austin! Eating What is Given" >
- KAIST Language Center
2023.02.09 View 14532 -
KAIST and KNUA to Collaborate on Culture Technology
Distinguished Visiting Scholar Soprano Sumi Jo Accompanied by AI pianist ‘VirtuosoNet’ during the Special Concert at KAIST
KAIST will expand the convergence of arts education and culture technology research in collaboration with the Korea National University of Arts (KNUA), the nation’s top arts university. KAIST President Kwang Hyung Lee signed an MOU with President Daejin Kim of the Korea National University of Art on January 6 at KAIST’s Daejeon campus for collaborations in arts education and research.
KAIST and KNUA will expand educational programs such as student exchanges and co-credit programs. The two universities will team up for cooperation focusing on research centers and academic conferences for the creation of culture technology and convergence arts.
Minister of Culture, Sports, and Tourism Hee Hwang also attended the ceremony. Minister Hwang said that the Ministry will invest 132 billion KRW in R&D for developing metaverse and content technologies. He added that this collaboration will be a very meaningful turning point for creating a new culture combining high-level technologies.
President Kim also expressed his expectations saying, “The collaboration of our two universities will generate a huge synergistic impact for nurturing talents and the creation of convergence arts.
President Lee said that the collaboration with KNUA will take KAIST another step forward as it aims to foster well-rounded talents. “We look forward to proactive collaborative research that will expand the new chapter of convergence arts and future stage performances.”
Right after the signing ceremony, world renowned soprano Sumi Jo, who was named a Distinguished Visiting Scholar, took the KAIST auditorium stage for a special concert. AI pianist ‘VirtuosoNet’, developed by Professor Juhan Nam at the Graduate School of Culture Technology, made its debut at the concert by playing Mozart’s Turkish March arranged by Arcardi Volrodos. VirtuosoNet also accompanied Soprano Jo on one of her songs.
The concert by Sumi Jo and AI pianist VirtuosoNet heralds what KAIST is pursuing for education and research in culture technology. The Graduate School of Culture Technology plans to conduct research on future culture industries combined with technologies for the metaverse. The Sumi Jo Performing Arts Research Center will conduct research on performing technologies together with virtual artists. Head of the Graduate School of Culture Technology Woontack Woo said that KAIST will expand the sphere of the culture industry including tourism in collaboration with KNUA by incorporating technology into arts.
2022.01.10 View 11686 -
Recipe for Success: Reputations Start from Inner Circles
A study on social network data of EDM DJs finds the relationship between social standing and identity building
If you would like to succeed in your career, carve out your own distinctiveness, then break your boundaries along with collaborators. This sounds very common. However, a study on social networks has proven that is the recipe for success.
A recent research on electric dance music DJs’ music identity and their reputation found that music DJs with a distinct genre identity as well as network positions combining brokerage and cohesion tend to place higher in terms of their social standing.
What do Calvin Harris, the star of Electro house, Diplo, the icon of Moombahton & Trap, Sebastian Ingrosso, the master of Progressive House, and Armin Van Buuren, the leader of Trance have in common? One commonality of these star DJs in the electronic music market is that they are the leaders who build their genres with solid musical identities and are artists who constantly try experimental and innovative connections with other genres.
Professor Wonjae Lee and Dr. Hyeongseok Wi from the Graduate School of Culture and Technology analyzed the playlist data performed by electronic dance music (EDM) DJs at several EDM festivals that were popular around the world before COVID-19 and the track data that they released during that period.
“This study investigates how social standing is attained within a professional group of artists whose members play a key role in evaluating their artistic products in the EDM market,” said Professor Lee.
Particularly, the team considered DJs' social standing as an effective means of ensuring the quality of their artwork in emerging music markets such as EDM and identified two important factors, the musical identity and the social position within the professional DJ’s group.
They analyzed the data from 3,164 playlists of 815 DJs who performed at nine festivals held from 2013 to 2016 as a sort of citation network among DJs, and transformed it into network data to measure social positions among the DJs. They considered the DJs who received a lot of citations from other DJs as having a high social standing. In addition, the genre, beats per minute (BPM), and key scale data of the songs released during the period were quantified to analyze the association with the musical identity.
First, the results of analysis of the released track data demonstrated that focused distinct musical identity is correlated with social standing among EDM DJs. The EDM market is an emerging specialist market that is constantly developing and differentiating new styles and genres. It includes artists who establish value criteria and demarcate categorical space into separate identity positions reflecting the artistic forms of a similar type.
Second, this study focuses on the two advantages of two types of social positioning, brokerage and cohesive, which can effectively reduce uncertainty in the market. The results show that DJs with a hybrid position, combining elements of both brokerage and cohesion, have higher social standing. This hybrid position is the most advantageous position for controlling new opportunities and inflows of resources and for utilizing them. Unlike existing studies that divide the merits of the two positions into a dichotomy, this study follows the practice of recent studies that show that the two positions can generate synergy in a complementary manner.
The remix culture prominent in EDM provides a convincing explanation for this phenomenon. Because constructing playlist sets represents a DJ’s main specialty, the ability to creatively combine a variety of tracks using one’s own artistic style is crucial. To showcase their remix skills, DJs skillfully select tracks to maximize the displays of their talent. Recognized DJs prefer to select tracks from other genres, borrowing from existing contexts and creating new reinterpretations while drawing upon their own musical backgrounds.
“Acquiring social acknowledgement within a professional group is an effective way to ensure the quality of products they produce and a strong reputation,” explained Professor Lee.
The research team also pointed out the unique case of Techno DJs, who are showing Galápagos syndrome by avoiding crossover between genres and sticking to their own musical identity, unlike most genres in EDM. This research was reported in PLos ONE on Aug. 25 and funded by KAIST and the BK21 Plus Postgraduate Organization for Content Science.
-ProfileProfessor Wonjae LeeGraduate School of Culture TechnologyKAIST
-PublicationHyeongseok Wi, Wonjae Lee “Stars inside have reached outside: The effects of electronic dance music DJ’s social standing and musical identity on track success,” Aug.25, 2021 PLosONE (https://doi.org/10.1371/journal.pone.0254618)
2021.09.09 View 10908 -
Rachmaninoff the most innovative of 18th and 19th century composers according to network science
Rachmaninoff, followed by Bach, Brahms and Mendelssohn, was the most innovative of the composers who worked during the Baroque, Classical and Romantic eras of music (1700 to 1900) according to a study published in the open access journal EPJ Data Science.
A team of researchers from KAIST (Korea Advanced Institute of Science and Technology), calculated novelty scores for 900 classical piano compositions written by 19 composers between approximately 1700 and 1900. The scores were based on how musical compositions differed from all prior pieces of piano music and how they differed from previous piano works by the same composer. The authors found that composers from the Romantic era (1820 to 1910) tended to have high novelty scores.
The authors from the Graduate School of Culture Technology at KAIST created a computer model which divided each composition into segments called ‘codewords’. Each ‘codeword’ consisted of all of the notes played together at a given time. Sequences of ‘codewords’ were then compared between compositions. The similarities between the sequences were used to create novelty scores for each composer and to determine the extent to which composers influenced each other.
Juyong Park, the corresponding author, said: “Our model allows us to calculate the degree of shared melodies and harmonies between past and future works and to observe the evolution of western musical styles by demonstrating how prominent composers may have influenced each other. The period of music we studied is widely credited for having produced many musical styles that are still influential today.”
The model distinguished each new musical period from the one before it by the rise of newly dominant and highly influential composers that indicated dramatic shifts in musical styles. The authors found that compositions from the Classical period (1750 to 1820) tended to have the lowest novelty scores. During this period Haydn and Mozart were highly influential but were later overtaken by Beethoven during the Classical-to-Romantic transitional period.
The most innovative composer, indicated by the highest combined novelty score, was Rachmaninoff. His work during the Romantic era was novel when compared to the compositions of the other 18 composers included in the study, and his later works were novel compared to his earlier works.
Lower novelty did not necessarily correlate with low influence. Beethoven was ranked in the lower half of novelty scores yet was the most influential composer during the Romantic period (1820 to 1910) and is widely considered one of the greatest composers of all time.
Dr. Park said: “While novelty is necessary in a creative work it cannot account for all the creative and artistic qualities that go into creating melodies and harmonies that spread to later generations of composers. That may be why being more novel did not necessarily result in composers being more influential.”
The authors suggest that their method could be applied to narrative or visual artworks by creating codewords from groups of words or colours and shapes. However, they caution that as only piano compositions were included in their analysis, it is unknown whether including all works by the 19 composers would have resulted in another composer being identified as the most original.
Profile: Prof. Juyong Park, PhD
juyongp@kaist.ac.kr
Graduate School of Culture Technology (CT)
Korea Advanced Institute of Science and Technology (KAIST)
https://www.kaist.ac.kr
Daejeon 34141, Korea
(END)
2020.01.31 View 7831 -
Image Analysis to Automatically Quantify Gender Bias in Movies
Many commercial films worldwide continue to express womanhood in a stereotypical manner, a recent study using image analysis showed. A KAIST research team developed a novel image analysis method for automatically quantifying the degree of gender bias in films.
The ‘Bechdel Test’ has been the most representative and general method of evaluating gender bias in films. This test indicates the degree of gender bias in a film by measuring how active the presence of women is in a film. A film passes the Bechdel Test if the film (1) has at least two female characters, (2) who talk to each other, and (3) their conversation is not related to the male characters.
However, the Bechdel Test has fundamental limitations regarding the accuracy and practicality of the evaluation. Firstly, the Bechdel Test requires considerable human resources, as it is performed subjectively by a person. More importantly, the Bechdel Test analyzes only a single aspect of the film, the dialogues between characters in the script, and provides only a dichotomous result of passing the test, neglecting the fact that a film is a visual art form reflecting multi-layered and complicated gender bias phenomena. It is also difficult to fully represent today’s various discourse on gender bias, which is much more diverse than in 1985 when the Bechdel Test was first presented.
Inspired by these limitations, a KAIST research team led by Professor Byungjoo Lee from the Graduate School of Culture Technology proposed an advanced system that uses computer vision technology to automatically analyzes the visual information of each frame of the film. This allows the system to more accurately and practically evaluate the degree to which female and male characters are discriminatingly depicted in a film in quantitative terms, and further enables the revealing of gender bias that conventional analysis methods could not yet detect.
Professor Lee and his researchers Ji Yoon Jang and Sangyoon Lee analyzed 40 films from Hollywood and South Korea released between 2017 and 2018. They downsampled the films from 24 to 3 frames per second, and used Microsoft’s Face API facial recognition technology and object detection technology YOLO9000 to verify the details of the characters and their surrounding objects in the scenes.
Using the new system, the team computed eight quantitative indices that describe the representation of a particular gender in the films. They are: emotional diversity, spatial staticity, spatial occupancy, temporal occupancy, mean age, intellectual image, emphasis on appearance, and type and frequency of surrounding objects.
Figure 1. System Diagram
Figure 2. 40 Hollywood and Korean Films Analyzed in the Study
According to the emotional diversity index, the depicted women were found to be more prone to expressing passive emotions, such as sadness, fear, and surprise. In contrast, male characters in the same films were more likely to demonstrate active emotions, such as anger and hatred.
Figure 3. Difference in Emotional Diversity between Female and Male Characters
The type and frequency of surrounding objects index revealed that female characters and automobiles were tracked together only 55.7 % as much as that of male characters, while they were more likely to appear with furniture and in a household, with 123.9% probability.
In cases of temporal occupancy and mean age, female characters appeared less frequently in films than males at the rate of 56%, and were on average younger in 79.1% of the cases. These two indices were especially conspicuous in Korean films.
Professor Lee said, “Our research confirmed that many commercial films depict women from a stereotypical perspective. I hope this result promotes public awareness of the importance of taking prudence when filmmakers create characters in films.”
This study was supported by KAIST College of Liberal Arts and Convergence Science as part of the Venture Research Program for Master’s and PhD Students, and will be presented at the 22nd ACM Conference on Computer-Supported Cooperative Work and Social Computing (CSCW) on November 11 to be held in Austin, Texas.
Publication:
Ji Yoon Jang, Sangyoon Lee, and Byungjoo Lee. 2019. Quantification of Gender Representation Bias in Commercial Films based on Image Analysis. In Proceedings of the 22nd ACM Conference on Computer-Supported Cooperative Work and Social Computing (CSCW). ACM, New York, NY, USA, Article 198, 29 pages. https://doi.org/10.1145/3359300
Link to download the full-text paper:
https://files.cargocollective.com/611692/cscw198-jangA--1-.pdf
Profile: Prof. Byungjoo Lee, MD, PhD
byungjoo.lee@kaist.ac.kr
http://kiml.org/
Assistant Professor
Graduate School of Culture Technology (CT)
Korea Advanced Institute of Science and Technology (KAIST)
https://www.kaist.ac.kr Daejeon 34141, Korea
Profile: Ji Yoon Jang, M.S.
yoone3422@kaist.ac.kr
Interactive Media Lab
Graduate School of Culture Technology (CT)
Korea Advanced Institute of Science and Technology (KAIST)
https://www.kaist.ac.kr Daejeon 34141, Korea
Profile: Sangyoon Lee, M.S. Candidate
sl2820@kaist.ac.kr
Interactive Media Lab
Graduate School of Culture Technology (CT)
Korea Advanced Institute of Science and Technology (KAIST)
https://www.kaist.ac.kr Daejeon 34141, Korea
(END)
2019.10.17 View 35184 -
Professor Ji-Hyun Lee Awarded the Sasada Prize
Professor Ji-Hyun Lee from the Graduate School of Culture Technology was awarded the Sasada Prize during the 24th annual Conference of Computer-Aided Architectural Design Research in Asia (CAADRIA) held in Wellington, New Zealand on April 15.
The Sasada Award honors the late Professor Tsuyoshi Sasada (1941-2005), the former Professor of Osaka University and co-founder and fellow of CAADRIA. It is given to an individual who has contributed to the next generation of researchers and academics, to the wider profession and practice in computer-aided design and research, and has earned recognition in the academic community.
Professor Lee was recognized for her development of CAAD (Computer-Aided Architectural Design) through her research work on the land price precision system using case-based reasoning. Her research team proposed a model for estimating the average apartment price in an administrative district after collecting 40 variables from the six major Korean cities, excluding Seoul and Ulsan. Their follow-up studies showed the possibility of replacing existing experts’ predictions.
Professor Lee has been steadily researching for 20 years on case-based reasoning (CBR), a field of artificial intelligence, and has published more than 40 papers in the field of CBR. Meanwhile, the CAAD Future 2019 event will be held at KAIST in June.
2019.04.23 View 12227 -
A Glance at the 2017 KAIST Literary Awards Ceremony
Since KAIST is a university specializing in science and engineering, people may think that the students rarely engage in literary activities. But KAIST students also excel in writing literature.
The 23rd KAIST Literary Award Ceremony was held on December 14 on the KAIST main campus. The award was established in 1995 to encourage students’ creative activities and to promote literary attainment. It is open to all KAIST students from undergraduate to masters and PhD students. This year, 43 students submitted a total of 68 literary works in the genres of poetry, novel, critique, and scenario.
KAIST professors Dong Ju Kim, Bong Gwan Jun, and Yunjeong Jo from the School of Humanities & Social Sciences participated as judges for the awards and they were joined by writers from the 8th Endless Road Program who served as invited judges for the novels and scenarios.
The Endless Road Program is a KAIST project for supporting artists who are engaged in literary works including scenarios, novels, webtoons, and movies by providing residences and funds. Novelists Jin Young Choi and Hak Chan Kim participated as judges for the novels and a drama scriptwriter, Joo Kim, as a judge of the scenarios.
After thorough evaluation, four submissions were chosen as awardees.
Section
Award
Name
Poetry
Winner
Sung Gil Moon (PhD candidate from the College of Business)
Runner-up
Jong Ik Jeon (Undergraduate student)
Novel
Winner
Joo Hwan Kim
(Undergraduate from the Dept. of Chemical and Biomolecular Engineering)
Runner-up
-
Essay & Critique
Winner
-
Runner-up
Jung Joon Park
(PhD candidate from the Dept. of Bio and Brain Engineering)
Scenario
Winner
-
Runner-up
-
The literary works as well as a review of the awards will be published in the KAIST Times in 2018.
2017.12.15 View 12360 -
Professor Woontack Woo Demonstrates an Optical Platform Technology for Augmented Reality at Smart Cloud Show
Professor Woontack Woo of the Graduate School of Culture Technology at KAIST participated in the Smart Cloud Show, a technology exhibition, hosted by the university’s Augmented Human Research Center and presented the latest development of his research, an optical platform system for augmented reality.
This event took place on September 16-17, 2015 at Grand Seoul Nine Tree Convention Center in Seoul.
At the event, Professor Woo introduced a smart glass with an embedded augmented reality system, which permits remote collaboration between an avatar and the user’s hand.
The previous remote collaboration was difficult for ordinary users to employ because of its two-dimensional screen and complicated virtual reality system.
However, with the new technology, the camera attached to artificial reality (AR) glasses recognizes the user’s hand and tracks it down to collaborate. The avatar in the virtual space and the user’s hand interact in real space and time.
The key to this technology is the stable, real-time hand-tracking technique that allows the detection of the hand’s locations and the recognition of finger movements even in situations of self-occlusion.
Through this method, a user can touch and manipulate augmented contents as if they were real-life objects, thereby collaborating remotely with another user who is physically distant by linking his or her movements with an avatar.
If this technology is adopted widely, it may bring some economic benefits such as increased productivity due to lower costs for mobility and reduction in social overhead costs from the decrease in the need of traveling long distance.
Professor Woo said, “This technology will provide us with a greater opportunity for collaboration, not necessarily restricted to physical travelling, which can be widely used in the fields of medicine, education, entertainment, and tourism.”
Professor Woo plans to present his research results on hand-movement tracking and detection at the 12th International Conference on Ubiquitous Robots and Ambient Intelligence (URAI 2015), to be held on October 28-30, 2015, at Kintex in Goyang, Korea.
He will also present a research paper on remote collaboration at the ICAT-EGVE 2015 conference, the merger of the 25th International Conference on Artificial Reality and Telexistence (ICAT 2015) and the 20th Eurographics Symposium on Virtual Environments (EGVE 2015), which will take place on October 28-30, 2015 at the Kyoto International Community House, Kyoto, Japan.
2015.09.16 View 15097