After lively discussions and long term surveys and research I finally got the hint (from Horst Eidenberger) that the semantic gap has been introduced by Simone Santini and Ramesh Jain in 1998 in their publication “Beyond Query by Example“. The semantic gap describes the inability to get high level features (or semantics) out of low level features in multimedia retrieval. Many references for the semantic gap point to the book Visual Information Retrieval of Alberto Del Bimbo.
Including multimedia capabilities in a Java applications has led many developers to the Java Media Framework (JMF). Although it nicely integrates with the Java VM it has one major drawback: The JMF has to be installed by the user and cannot be packaged with an application as jar file or library, as it is not pure Java. Furthermore the API is not very intuitive. Professional alternatives are rare. On the one hand developers can use the Quicktime Java library, which allows the integration of Quicktime functionality in Java applications based on native calls. As with JMF the Quicktime libraries have to be installed on the target system. Another option is the use of SWT. To integrate multimedia functionality for example windows media player can be called from within an SWT widget. Unfortunately there is no Windows Media Player on Linux host systems, so another alternative has to be found. And there we found the major drawback of SWT: While windows is supported very well, Linux and especially MacOS support is not productive (yet). Furthermore it is assumed that a decent media players and libraries are pre-installed at the target system.
To summarize above findings: None of the above media frameworks is able to be bundled with a Java application, Web Start or applet, as it is not pure Java. The behavior of all three alternatives differs on different platforms, whereas JMF and Quicktime behave best. However Quicktime has no Linux port, so no real platform independent solution will be possible. SWT on the other hand works on all platforms but needs native calls, so that is another problem and not very platform independent.
On the 5th Multimedia Metadata Community Workshop I heard an interesting talk from Horst Eidenberger about programming mobile phones with Java ME. He focused on the Symbian Series 60 3rd Edition OS and its capabilities. Fortunately an article will appear summarizing his findings, unfortunatel it will be published in germen (upcoming iX 11/06). A description of the OS can be found at the Nokia Forum.
Interesting enough is the integration of Java APIs, which allow access to location information (e.g. using GPS, see JSR 179), the FM tuner and music capabilites of the mobile phones (see JSR 234) and displaying and manipulation of SVG 2D images (see JSR 226). Furthermore now a Java API for 3D graphics is integrated (see JSR 184). If you want to dive into this topic, Horst recommended at his talk to download Carbide.j for Eclipse. Lots of examples are bundled with the download … just give it a try.
Received following Call for Papers some days ago: [...] announce that the next IEEE International Conference on Multimedia & Expo (ICME 2007) will be held from Jul 2-5, 2007 in Beijing, China. Papers in the following and other areas of multimedia are solicited:
- Audio, image, video processing
- Virtual reality and 3-D imaging
- Signal processing for media integration
- Multimedia Communications and networking
- Multimedia security and content protection
- Multimedia human-machine interface and interaction
- Multimedia databases
- Multimedia computing systems and appliances
- Hardware and software for multimedia systems
- Multimedia standards and related issues
- Multimedia applications
- Multimedia and social media on the Internet
In addition, there will be invited speakers, special sessions and tutorials on many current topics in multimedia. More details can be found in the attached Call for Paper and the conference website http://www.icme2007.org.
- Special session proposals: Dec 1, 2006
- Tutorial proposals: Dec 1, 2006
- Regular paper submissions: Jan 5, 2007
- Notification of acceptance: Mar 19, 2007
- Camera-ready papers: April 16, 2007
Some days ago above mentioned special issue was put online. As the JUKM is an open access journal, everyone can view and download the published articles. Within the peer reviewed issue the results of the Multimedia Metadata Community workshop series in 2005 are presented:
- Analysis of the Data Quality of Audio Descriptions of Environmental Sounds, Dalibor Mitrovic, Matthias Zeppelzauer and Horst Eidenberger from the Vienna University of Technology, Austria
- MPEG-7 meets Multimedia Database Systems, Mario DÃ¶ller from the University Passau, Germany
- A Description Infrastructure for Audiovisual Media Processing Systems Based on MPEG-7, Peter Schallauer, Werner Bailer and Georg Thallinger from Joanneum Research in Graz, Austria
- Community Hosting with MPEG-7 Compliant Multimedia Support, Ralf Klamma, Marc Spaniol and Yiwei Cao from the RWTH Aachen, Germany
- Semantic Applications on MPEG-7 Descriptions of Multi-modal Meeting Corpora: First Results, Victor Manuel GarcÃa-Barrios and Christian GÃ¼tl from the Graz University of Technology, Austria
- On the Complexity of Annotation with the High Level Metadata, Mathias Lux from the Klagenfurt University in Austria and Michael Granitzer and Werner Klieber from the Know-Center Graz, Austria
The last article shows the results of an user evaluation of Caliph, which yielded quite interesting results. The user questionaire showed that users could imagine usage semantic descriptions in a professional environment, but not for personal use due to the complexity of annotation.
As posted by Ralf Klamma in his Blog the 2nd International Symposium in Media Informatics – “Cow Paths: Agency in Social Software” takes place in Bonn, Germany, on 16-17th of Nov. 2006. The full CfP is available here, additional information can be found on http://www.medien-informatik.eu.
I’m presenting on a workshop on the symposium (WS2: User Generated Content & User Generated Metadata) together with Ines Puntschart from the Know-Center / Graz University of Technology.
From Sept. 6th to Sept. 8th 2006 I’ve been at the 6th I-Know conference in Graz, Austria. There also the 5th Multimedia Community Workshop, where a lot of interesting topics have been discussed. The program can be found here, presentations and papers will be put online.
Within the internal workshop on Friday 8th of Sept. following presentations were given:
- Java-Media Programming on Mobile Devices (by Horst Eidenberger)
- Visualisation Ideas for the MISTRAL Meeting Explorer (by Vedran Sabol)
- The DANAE project and future perspectives (by Christian Timmerer)
- Formalizing semantics of MPEG-7 descriptions (by Werner Bailer)
All presentations will be put online on the community portal along with additional material.