-- Language -- Arabic Bengali Bulgarian Chinese English Finnish French German Greek Hindi Indonesian Italian Japanese Korean Nederlands Persian Portuguese Russian Spanish Thai Trukish Vietnamese

* Currently, English is used if we do not have translations

ISeee Project: Information Support of Everyone, by Everyone, for Everyone

What is ISeee Project?

ISeee is an abbreviation of "Information Support of Everyone, by Everyone, for Everyone."

• - Information Support
• - of Everyone
• - by Everyone (Everyone provides information support)
• - for Everyone (Everyone receives information support)

Information support is the technology that helps people with disabilities acquire information using alternative means. ISeee project applies crowdsourcing technique to the field of information support and aims to provide a platform where everyone can make good use of their abilities to provide information support so that everyone can receive information support regardless of disabled or non-disabled people. We expect to realize a society where everyone can say "I see."

As the first step, we are developing a crowdsourcing-based system of sign language captioning by deaf and hard-of-hearing people. Multiple non-expert people who know sign language cooperate to interpret sign language to text in real-time, which provides information support to the people who do not know sign language. One of our goal is to achieve a practical use of the system at academic conventions by the end of fiscal 2017. The constructed system will be open to the public.

People

• Rumi Hiraga (Tsukuba University of Technology)
• Yuhki Shiraishi (Tsukuba University of Technology)
• Jianwei Zhang (Iwate University)
• Daisuke Wakatsuki (Tsukuba University of Technology)
• Takeaki Shionome (Teikyo University)
• Takuya Suzuki (Tsukuba University of Technology)
• Ying Zhong (University of Tsukuba)
• Masaki Matsubara (University of Tsukuba)
• Atsuyuki Morishima (University of Tsukuba)
• Makoto Kobayashi (Tsukuba University of Technology)
• Yoshiki Fukunaga (Tsukuba University of Technology)
• Manabi Miyagi (Tsukuba University of Technology)
• Chiemi Watanabe (Tsukuba University of Technology, University of Tsukuba)

Past People

• Hirotaka Hashimoto (University of Tsukuba, till fiscal 2017)
• Katsumi Kumai (University of Tsukuba, till fiscal 2016)
• Emi Sakurai (University of Tsukuba, till fiscal 2015)
• Akiko Kawabata (University of Tsukuba, till fiscal 2015)

Achievements

1. Ying Zhong, Masaki Matsubara, Makoto Kobayashi and Atsuyuki Morishima: Understandable Microtasks With No Visual Representation. WorkInProgress,The seventh AAAI Conference on Human Computation and Crowdsourcing (HCOMP2019), Skamania Lodge, WA, Oct 28–30, 2019.
2. Hirotaka Hashimoto, Masaki Matsubara, Yuhki Shiraishi, Daisuke Wakatsuki, Jianwei Zhang and Atsuyuki Morishima: A Task Assignment Method Considering Inclusiveness and Activity Degree. In Proceedings of The Second IEEE Workshop on Human-in-the-loop Methods and Human Machine Collaboration in BigData (IEEE HMData2018), pp. 3498-3503 , Seattle, WA, USA, 2018.
3. Ying Zhong, Masaki Matsubara, Atsuyuki Morishima. Identification of Important Images for Understanding Web Pages. In Proceedings of The Second IEEE Workshop on Human-in-the-loop Methods and Human Machine Collaboration in BigData (IEEE HMData2018), pp. 3567－3573, Seattle, USA, Dec 10 (Dec 10-13), 2018.
4. Daisuke Wakatsuki, Rumi Hiraga, Makoto Kobayashi, Yuhki Shiraishi, Takeaki Shionome, Jianwei Zhang, Yoshiki Fukunaga, Manabi Miyagi, Atsuyuki Morishima, "A Study on Information Support for Deaf and Hard-of-Hearing People Using Sports Game Timeline", The 2018 IEEE International Conference on Systems, Man, and Cybernetics(IEEE SMC2018), pp.2244-2249，Miyazaki, Japan, October 2018．
5. Katsumi Kumai, Masaki Matsubara, Yuhki Shiraishi, Daisuke Wakatsuki, Jianwei Zhang, Takeaki Shionome, Hiroyuki Kitagawa and Atsuyuki Morishima, Skill-and-Stress-Aware Assignment of Crowd-Worker Groups to Task Streams, The sixth AAAI Conference on Human Computation and Crowdsourcing (HCOMP2018), pp.88-97, Zurich, Switzerland July 6 (July 5–8), 2018
6. Takeaki Shionome, Hirotaka Hashimoto, Jianwei Zhang, Yuhki Shiraishi, Daisuke Wakatsuki, Yohei Seki, and Atsuyuki Morishima,“Complement of Incomplete Task Results for Real-time Crowdsourcing Interpretation”, Proc. 21th International Conference on Asian Language Processing (IALP 2017), pp.359-362, Singapore, December 2017.
7. Katsumi Kumai, Jianwei Zhang, Yuhki Shiraishi, Daisuke Wakatsuki, Hiroyuki Kitagawa, Atsuyuki Morishima, "Group Rotation Management in Real-Time Crowdsourcing", Proc. 19th International Conference on Information Integration and Web-based Applications & Services (iiWAS 2017) , pp.23-31, Salzburg, Austria, December 2017.
8. Yuhki Shiraishi, Jianwei Zhang, Daisuke Wakatsuki, Katsumi Kumai, and Atsuyuki Morishima, "Crowdsourced Real-Time Captioning of Sign Language by Deaf and Hard-of-Hearing People", International Journal of Pervasive Computing and Communications, Vol. 13, No. 1, pp.2-25, 2017. (Highly Commended Award by Emerald Publishing)
9. Jianwei Zhang, Yuhki Shiraishi, Katsumi Kumai, and Atsuyuki Morishima, "Real-Time Captioning of Sign Language by Groups of Deaf and Hard-of-Hearing People", Proc. The 18th International Conference on Information Integration and Web-based Applications & Services (iiWAS 2016), pp.56-65, Singapore, November 2016.
10. Katsumi Kumai, Yuhki Shiraishi, Jianwei Zhang, Hiroyuki Kitagawa and Atsuyuki Morishima, "Group Rotation Type Crowdsourcing", The Fourth AAAI Conference on Human Computation and Crowdsourcing (HCOMP 2016), Work-in-Progress Poster, 3 pages, Austin, Texas, USA, November 2016.

    Cooperative Organization

    • NPO STAND
    • IPSJ DBS

    Support Organization / Funding

    • This work is partially supported by NII, Tsukuba University of Technology, JST, JSPS.