【CAMGAME】视频游戏软件及其开发平台
Would you like to react to this message? Create an account in a few clicks or log in to continue.
【CAMGAME】视频游戏软件及其开发平台

是第一个国产原创使用网络摄像头所获取的视频进行各种单机游戏,flash小游戏以及虚拟现实原创游戏的软件项目,使用最先进的技术,带给你前所未有的体验,摆脱一切束缚,尽情的娱乐。


您没有登录。 请登录注册

[转载] HCI^2 Framework: Recommended Test Sequence

向下  留言 [第1页/共1页]

hhj

hhj
创世神

注1:本文转载自HCI^Framework(也就是我们的游戏所使用的软件框架)的官方网站(原文地址:http://sites.google.com/site/hci2framework/news/recommendedtestsequence)。出于多方面因素考虑,我们目前暂不提供该软件平台的公开测试版本。如果您有兴趣参加我们的内部测试或在未来的工作中使用该平台,请用站内信或电子邮件和我联系(shenjie_hhj@163.com)。

注2:如插图在您的浏览器中不能显示或显示不全,请首先尝试用您的ID登陆,如问题仍然存在,请点击文章末尾的附件查看原图。


Thank you very much for your interests in testing the HCI^2 Framework! The HCI^2 Framework is currently in its internal beta test stage, meaning that it is already a complete software tool chain supporting the entire development process of multimodal human-computer interaction systems. Nonetheless, in order to get familiar with the HCI^2 Framework as fast as possible, and to save your valuable time spent on the trial-and-error navigation, the following test sequence is highly recommended.
1. Ensure the compatibility of your system
To install and run the HCI^2 Framework, your computer should be using Windows XP SP3, Windows Vista, or Windows 7. All other third party software tools required by the HCI^2 Framework itself or some of the demo systems are delivered with the redistribution package. Regarding hardware, there is no specific requirement, as long as your computer is powerful enough to work smoothly in the conventional day-to-day usage. Nonetheless, since all of our demo systems require real-time video feed, it is essential that your computer is connected to an applicable webcam. To validate that, please navigate to 'My Computer' to see if there is at least one camera icon displayed in the 'Scanners and Cameras' category.

2. Download the redistribution package
The redistribution package can be downloaded from the 'Files' page on this website. There are three files you need to download, which are: Prerequisite_2010_04_13.part1.rar, Prerequisite_2010_04_13.part2.rar, and Internal_Redist_2010_05_12_Lite.rar. To unzip these files, WinRAR is needed. Moreover, note that the Internal_Redist_2010_05_12_Lite package is protected by a decompression password. Please e-mail me (shenjie_hhj@163.com) if you do not have the password so far.

3. Install the required third party software tools
Three installation files have been packed in the Prerequisite_2010_04_13 package. Please install them in the following order:
3.1 Install Visual Studio 2005 runtime libraries
Note that you may skip this step if Visual Studio 2005 is installed on your computer. To install the runtime libraries, please navigate to 'Prerequisite\vcredist_x86' and double click 'vcredist_x86.exe' to execute the installation programme.

3.2 Install MSXML6
MSXML6 is a parser / composer for XML files. We have provided two installation files for MSXML6, one ('msxml6.msi') for its runtime components only and the other one ('msxml6_SDK.msi') also contains its SDK. If you are intended to develop your own module programmes, msxml6_SDK.msi is the one you will need. Otherwise, you may choose to install msxml6.msi, which uses less disk space. Nevertheless, please note that failure to install msxml6.msi has been reported by some of our previous testers using Windows Vista. In comparison, installing msxml6_SDK.msi has always been successful, and thus is recommended in all cases.
3.3 Install OpenCV 1.0
OpenCV is a computer vision algorithm library used by some sample modules. To install it, simply double click 'OpenCV_1.0.exe' and click 'Next' or 'OK' in all of the installation wizard pages. To avoid potential problems involving file directories, please do not change the installation settings during the process. Furthermore, due to some BUGs in the OpenCV's installation programme, it may fail to update the environment variable 'path' appropriately. Therefore, you are advised to check the environment variable after executing 'OpenCV_1.0.exe' and manually update its value if necessary. To do that, please proceed as follows:
  1. Right click 'My Computer' and select 'Properties' in the popup menu to display the 'System Properties' dialogue box.
  2. In the 'System Properties' dialogue box, navigate to 'Advanced' property page and click 'Environment Variables' button to display the 'Environment Variables' dialogue box.
  3. In the 'Environment Variables' dialogue box, double click on the 'path' (since environment variable name is case-insensitive, it might be displayed as 'PATH' or 'Path' on your computer) entry to display the 'Edit User Variable' dialogue box.
  4. In the 'Edit User Variable' dialogue box, please check whether the path of the OpenCV's 'bin' folder (which should be 'C:\Program Files\OpenCV\bin' by default) is already included in the 'Variable Value'. If it is absent, please manually add the path at the end of the 'Variable Value' (with a semicolon separating it from the other paths) and click 'OK' in all displayed dialogue boxes.
In addition to the above software tools, you may also need to install DirectX 9.0c SDK if you are intended to rebuild the Video Capturer module using the provided source code. The installation package of this SDK is not included in our redistribution package due to its large size. Nonetheless, DirectX 9.0c SDK can be downloaded from various sources with ease because to its popularity among the community.
After installing the above software tools, a system reboot is recommended even if no installation programme has required so.
4. Install the HCI^2 Framework
The HCI^2 Framework has been built to avoid using Windows registry. Thus it requires no installation process. To deploy the HCI^2 Framework, simply unzip the Internal_Redist_2010_05_12_Lite package and it is ready to use.
5. Test the provided demo systems
Along with the core components of the HCI^2 Framework, we have also included a number of sample modules and demo systems in the redistribution package. In this section, we briefly describe these demo systems and how they may be tested.

The demo systems are described by the system configuration files stored in the 'Demo' folder. 4 system configuration files have been delivered, which are Video_Demo.xml, Face_Detection.xml, Game_Single.xml, and Game.xml. These systems will be explained later. For now, we firstly introduce the general method to load and execute a system:
  1. Launch the HCI^2 Workbench. To do this, simply navigate to 'Bin' folder and double click 'HCI2Workbench.exe'. If nothing happens thereafter or if some error message is displayed, it is most likely that the MSXML6 may have not been installed correctly. In that case, reinstalling MSXML6 might solve the problem.
  2. Load the system configuration file by using the 'File\Open' menu command. If the file is successfully loaded, you should see the graphical representation of the system structure shown in the HCI^2 Workbench's main window, as illustrated in Figure 1.
  3. Execute the loaded system by using the 'Control\Activate All' menu command. If the system is working properly, all lines and rectangles (representing channel mappings and module instances / channels, respectively) should be shaded in green instead of light purple. Note that 'File\New' and 'File\Open' menu commands will be temporarily disabled when any of module instances becomes active.
  4. To shutdown the system, you may use the 'Control\Deactivate All' menu command. After doing so, some module programmes may terminate quietly while others may display an error message saying 'server lost' before they close. When the entire system is completely deactivated, the rectangles representing module instances will return to the light purple hue and the 'File\New' and 'File\Open' menu commands will be enabled.
[转载] HCI^2 Framework: Recommended Test Sequence Download
Figure 1 The user inte***ce of the HCI^2 Workbench (click the image to enlarge).

In the remaining part of this section, we introduce the aforementioned system configuration files and the systems they describe.

5.1 Video_Demo.xml
Video_Demo.xml describes a very simple system demonstrating video capturing, colour-to-monochrome conversion, and video rendering. You should see two video rendered window when the system is working, as shown in Figure 2. The two video renderer windows should be displaying real-time video stream captured from the preferred webcam, one in colour and the other one in monochrome. The video renderer windows may be empty (technically, it displays a static background image) if the video capturer fails to initialize. In that case, the rectangle representing the 'Default Camera' module instance will switch back to light purple hue shortly after the 'Control\Active All' command is issued. This problem may be resolved by reinstalling the webcam driver.
[转载] HCI^2 Framework: Recommended Test Sequence Download
Figure 2 The video capturing demo system (click the image to enlarge).

5.2 Face_Detection.xml
Face_Detection.xml describes a demo system which performs face detection. When working properly, the system captures real-time video stream from the preferred webcam, detects faces in video using Viola-Jones face detection algorithm, and then displays the video stream with marked face boxes in the video rendered window. Figure 3 shows a screen-shot of this system at work. Note that due to the size of the system structure, not all module instances and channels are visible in the screen-shot. Similar to Video_Demo.xml, the video renderer windows may be empty if an error occurs while the system is running. Likewise, inability to start video capturering is a possible cause. Another frequently reported error is failure to initialize face detection, in which case the rectangle reprensting the 'Face Detector' module instance will be shaded in light purple. This normally happens if the module programme cannot locate appropriate OpenCV DLLs. Reinstalling OpenCV, as described in subsection 3.3, may fix this problem. Alternatively, you may copy all DLLs found in the OpenCV's 'bin' folder ('C:\Program Files\OpenCV\bin' by default) to the system folder (normally 'C:\WINDOWS\system32'). In both cases, you should restart the HCI^2 Workbench and reload the system to realize the changes.
[转载] HCI^2 Framework: Recommended Test Sequence Download
Figure 3 The face detection demo system (click the image to enlarge).

5.3 Game_Single.xml
Game_Single.xml describes an interactive gaming system. Essentially, the system allows you to play a game called NS-Shaft using an arbitrary object held by hand instead of the keyboard. NS-Shaft (http://en.wikipedia.org/wiki/NS-Shaft) is (perhaps was) a popular game among Chinese players. It is more commonly known as '是男人就下一百层' (literally 'Reach 100th floor if you're a guy'). The player's goal in the game is to control the game character, using only the left and right arrow keys, to descent to as deep as possible before it dies. In our demo system, we use an object detector to detect and track a designated object held by the player and a game controller to map the object's position to appropriate key strokes in order to control the game character. In short, when playing the game using our system, the game character will follow the movement of the tracked object. A screen-shot of this system is shown in Figure 4.
[转载] HCI^2 Framework: Recommended Test Sequence Download
Figure 4 Playing NS-Shaft using our gaming system and a colour marker pen (click the image to enlarge).

A step-to-stop tutorial on using this gaming system is given below.
  1. Choose an object for tracking. Due to the limitation of our object detection algorithm, you should use an object which is uniformly painted in a bright colour. A colour marker pen, as the one shown in Figure 4, will be a good choice.
  2. Load and execute the system by following the method described at the beginning of this section. If the system works properly, you should see the game window popping up, together with another window displaying the real-time video stream captured by the preferred webcam. If the video window does not show up, you may need to reinstall OpenCV. Otherwise, if the video window is popped up but it does not display the video stream, reinstalling webcam driver may help.
  3. Select the object in the video window to start tracking. To do so, you should click and drag in the video window to select a rectangular area within (not around) the object's image. The programme will automatically inflate the selected area to match the object's actual boundary. After the successful initialization of tracking process, you should see a red ellipse drawn around the object while you are moving it around. Many factors may affect the performance of our algorithm in terms of accuracy and precision. These include environmental light change, poor illumination, low frame rate, a poor choice of the object, and so on. In many cases, the quality of the tracking result can be significantly improved simply by switching to another object and / or reinitializing the object tracking process (i.e. make another selection in the video window).
  4. When the tracking result becomes satisfiable, you may start playing the game by clicking the '1P Start' button (please refer to Figure 5 for the meaning of the buttons) in the NS-Shaft window. Note that the game controller will only generate simulated key strokes if the NS-Shaft window retains keyboard focus. Thus when playing the game, you should never switch to another window or your game character will die very easily due to loss of control.
[转载] HCI^2 Framework: Recommended Test Sequence Download
Figure 5 The meaning of buttons displayed in NS-Shaft.

5.4 Game.xml
Game.xml describes a similar system to the previous one (Game_Single.xml). The only difference is it allows the game to be played in 2P mode. As its structure shows (illustrated in Figure 6), this system uses the same camera for both players. Nonetheless, modifying the system configuration to cope with two cameras (one for each player) is also rather straightforward. Because of its significant resemblance to Game_Single.xml, further details are omitted here for brevity.
[转载] HCI^2 Framework: Recommended Test Sequence Download
Figure 6 The gaming system supporting 2P mode, described by Game.xml (click the image to enlarge).

6. And Beyond...
The HCI^2 Framework can be used to achieve much more than what we have demonstrated so far. Most noticeably, through using the SDK and the other tools we have provided, you may build your own modules and systems with ease. However, since this article is intended to provide a quick tour only, we will not cover these advanced topics here. Nonetheless, you are certainly welcomed to explore them on your own.
Last but not the least, if you have any question, BUG report, and / or suggestion relating to the HCI^2 Framework, please feel free to let me know (shenjie_hhj@163.com). As always, your comments will be duly appreciated and I will be more than happy to offer my help :-)
附件
[转载] HCI^2 Framework: Recommended Test Sequence AttachmentFig1.JPG
您无权下载这里的附件。
(131 Kb) 下载60次
[转载] HCI^2 Framework: Recommended Test Sequence AttachmentFig2.JPG
您无权下载这里的附件。
(202 Kb) 下载57次
[转载] HCI^2 Framework: Recommended Test Sequence AttachmentFig3.JPG
您无权下载这里的附件。
(206 Kb) 下载56次
[转载] HCI^2 Framework: Recommended Test Sequence AttachmentFig4.JPG
您无权下载这里的附件。
(218 Kb) 下载56次
[转载] HCI^2 Framework: Recommended Test Sequence AttachmentFig5.JPG
您无权下载这里的附件。
(20 Kb) 下载56次
[转载] HCI^2 Framework: Recommended Test Sequence AttachmentFig6.JPG
您无权下载这里的附件。
(205 Kb) 下载56次

返回页首  留言 [第1页/共1页]

您在这个论坛的权限:
不能在这个论坛回复主题

 


  • 如何申请免费论坛 | ©phpBB | 互助中心 | 违法举报 | 最近的讨论

    友情链接:CamGame刺猬之家申请友情链接