A Self-Reconfigurable System of Contents among Smart Devices

I. INTRODUCTION

Expanding network connectivity to objects is an important part of a new generation of information technology, as known as the Internet of Things. This research motivated to create a method to support an object to perceive a change in another object’s physical position and the object also changes its state correspondingly, thus solves the problem, which is manual operation’ inconvenience and inaccuracy.

This research chooses the mobile devices as objects, develops an application to find the physical position of mobile devices. Moreover, it is proved through experiment the proposed algorithm is more feasible and accurate. The system establishes connections between mobile devices, and supports devices to perceive other device’s existence. The system records device’s initial physical position and then perceives change in device’s position. The system sends message to notify device about the changing position of the other device. After receiving notification message, the device performs contents reconfiguration. Most of the contents equation techniques only support one device to display content [1], but this paper proposes a new perspective to support multi devices with cooperative work for the user. And then according to user’s intention makes some corresponding changes.

This research uses Two Dimensional Relative Location method to support mobile device to detect changing in other device position. Contents Self-Reconfigurable System can support device to do corresponding behavior. The proposed system has following major three contributions:

About contents data transmission, this research proposes two methods as Total Contents Splitting (TCS) and Fragment Contents Splitting (FCS). By experimentation, this research analyzed and discussed under what circumstances the designed system chooses which method is more appropriate.

Since this system only needs lightweight hardware support, like sensors and P2P communication module. The proposed system, A Self-Reconfigurable System of Contents, is not only suitable for smart devices but also can apply on a lot of things.

This paper is organized as follow: Section II reviews the related works. Section III describes the proposed Contents Self-Reconfigurable System. Section IV presents the development and implementation of the System. Section V discusses the experimental result for the system. Finally, Section VI describes the conclusion of the research work.

II. RELATED WORKS

Junkyard Jumbotron is designed by the Center for Civic Media at MIT years ago[2]. In this scheme, the user is allowed to combine a group of mobile devices (including smart phones, tablet PCs and notebook computer) into a big screen. In this method, through input, an author provides a unique URL on every device (to connect server). Furthermore, the user takes a single photo for multiple screens and the image are analyzed by a special software that is mapping out the location of each screen in relation to the other device. Finally, the multiple images can be transferred to various mobile devices at the same time, by creating a fragmented effect. In this method, each device generates a unique QR code for identification of mobile devices. Further, the user uses other devices’ camera to recognize their QR codes in order to get mobile devices’ physical position, and then devices can map the contents on their screen

In Junkyard Jumbotron system, if the individual mobile device changes its physical position, it needs reposition and it needs manual operate contents presentation on the device again. In the research of Dynamic Tiling Display System[3], the author changes the position of device, and modifies the self-reconfigure contents on device. In this method, every device displays the same multimedia data and on using visual recognition by the camera device’s individual view of the rendering can be determined.

Some researche not only presented contents on devices screen, they emphasize the user needs interact with Multi-devices[4]. In Jun Tanaka and Takashi Ohta’s research[5], they devised an interface to relate applications, which are running on multiple smart phones. It is named “pinching”, a touch screens system for juxtaposed devices. Their system constructed a virtual display field by multiple screens. They design various contents of interaction that is a single screen unable to offer. In their research, the user can use a finger to touch two devices’ screen at the same time to establish connection and device position detection. Device’ screen appears an object, this object can move straight lines and cross device’s bezel(visual effect) into the other devices.

A team from Aalborg University Centre for Society-Interactive Design shows results of their study Juxta Pinch [6]. In their design, they had two contributions, the first contribution discusses multi mobile devices interaction[7] application by a meaningful study. This study has opportunities and challenges related to use of several devices at the same time. Secondly, their contribution discusses the collocation image sharing research through demonstration of user interaction and exploration of friend’s photos. Their research allows pinching three devices to connect devices. And they implemented JuxtaPinch as a web application. They developed a multi-platform to support more devices. Hence, their system is implemented by the socket.io library setup a Node.js websocket server. The sensor of accelerometer and gyroscope are used to detect when devices change its physical position[9].Jun Tanaka, Takashi Ohta’s research and Aalborg University Centre for Society-Interactive Design’s research and some other research [8] proposed their system gets device physical position information main using manual method.

In early 2014, researchers from Samsung issue their result of using Galaxy Note 3 devices one by one like a tile as a commodious screen to display video[10]. For example, in figure 2.6 group video display across multiple devices is illustrated. It has its own drawback which is contents delivery. In this case, before device connects each other presents contents on screen has been already shared to all devices storage. When the devices start collaborating the display contents, and the devices they just need to display a part of content, not the whole contents.

Patwari, N in his paper Relative location estimation in wireless sensor networks[11] described: For some devices, no relationship of their have absolute coordinate information or not can affect estimate between devices and neighboring devices. The location estimation method is called “relative location” method, as the range estimates collected, remarkable between two devices which neither has absolute coordinate information.

In recent years, as mobile devices become more popular, and smart mobile devices’ relative location estimation method is richer. In Wang Tian’s paper BlueCat: An Efficient Way for Relative Mobile Localization [12]. The work is identified if one mobile device user is located in the vicinities by other mobile users. The mobile device user can select Bluetooth as transfer data when general Bluetooth modules provided about 10 meters proximity range, which may enough for locate anther mobile device users in the vicinity. And one mobile user also could “perceive” other users through multi-hop to communication.

Actually whatever Patwari N’s research in 2003 and Wang Tian or other research [13] using similar theory in smart device, through complex calculation gets results not very accurate. In Patwari N’s research, the RMS location errors range from 1.0m to 2.7m. This error range can be accepted in spacious place, but in narrow space like in the room, on the table or bed, the error range from 1.0m to 2.7m cannot be allowed. This paper adopted a new method of relative location has more applicable to some narrow space location for the Contents Reconfiguration System.

III. CONTENTS SELF-RECONFIGURABLE SYSTEM

A complete Contents Self-Reconfigurable System contains a series processes. Firstly, the user can configure a system from of contents performance type: a two dimensional matrix, each device becomes one element in this matrix. The user inputs this matrix’s column and row value in one device. For example, the user inputs two by four matrix type of system, the system can get the system type is two by four two dimensional matrix. After user according inputted column and row value to put the device in one area as Fig 1, the device can get its position and who surround it.

Fig. 1. Two by four matrix type Contents Self-Reconfigurable System

Download Original Figure

In Fig.1 one device’s screen written ‘server’ denotes this device is server device. The part of connection in this System is developed by Wi-Fi P2P. One solution of mobile devices connection establishment is Wi-Fi P2P devices establish P2P group[14] to communicates each other. One device implements Ad-Hoc functionality in P2P group which is referred as P2P Group Owner(P2P GO), and other devices is known as P2P clients.

3.3. Content Splitting

After the system constructs new matrix S, the user can select specific content. This content will be divided into several parts according to the matrix S formed by Contents Portioning method. Using Contents Shuffling method in Contents Splitting module, the system sends segmentalized contents to all devices.

3.3.1 Content Portioning

After Device Matrix Initialization, matrix S has been established. If the user selects content, the system will be obtained content’s width and height such as O_w and O_h. The matrix S has m devices in rows and n devices in columns. In order to distribute original content, the system should divide the original contents into equal-sized contents. Given the width and height of segmentalized content as d_w and d_h, d_w = O_w/n, d_h = O_h/m.

The system adopts several types of the content. The types include image, video, and etc. Each formatted contents need different portioning methods to divide the contents. However, in this paper, we propose a common solution to portion the contents. In proposed method, first step is to generate a vector with d_w and d_h such as (d_w, d_h).

The system gives a start point (sp) to vector. This a start position of original content. If the content needs dividing into several parts, sp’s value is defined as equation (9).

$$sp=\left({\displaystyle \sum _{j=0}^{m}j*d_{w ,}{\displaystyle \sum _{i=0}^{n}i*d_h}}\right)$$

(9)

The system makes some parts of the original content. The number of the parts is m × n.

3.3.2 Content Shuffle

About contents data splitting process in the system, one method is server device splitting total contents to every client devices as TCS method(Total Contents Splitting) in this paper as Fig.2.

Fig. 2. TCS device contents splitting method

Download Original Figure

NB is network bandwidth, Cfs is contents file capacity size, quote dq is means device quantity, assume T_cs is contents splitting time, T_cs’s equation is (10).

$$T_{cs}={\displaystyle \sum _{i=0}^{dq}\frac{Cfs}{NB}}$$

(10)

In TCS method, the time of system using TCS method to transmit data is T_TCS. The notification message transfer between devices take almost negligible time, user main spend time on T_cs, so T_TCS ≈ T_cs.

This research also has another method to split contents data. Before server device broadcasts contents data to other device, the system completes fragmented with total contents. After this process, server device transfer specified content fragment to related device as Fig.3. This method is named FCS(Fragmented Contents Splitting) in this paper. After device detection, system also multicast contents change message to device as TCS but notification message’s type is different. In FCS method, notification message is not vector but start point, the system multicasts new contents to instead of original contents.

Fig. 3. FCS device contents splitting method

Download Original Figure

In method FCS, NB also network bandwidth, Cffs is fragment contents file capacity size. dq is device quantity and T_fs→ffs is process spent time of total contents to be fragment contents in devices. T′_cs is contents splitting time in this method. T′_cs’s equation as (11).

$$T{\text{'}}_{cs}=T_{fs\to ffs}+{\displaystyle \sum _{i=0}^{dq}\frac{Cffs}{NB}}$$

(11)

The system multicast new contents to device spent time as T_nc and express by (12)

$$T_{nc}=2\text{}\text{}\text{}\text{}\ast \frac{Cffs}{NB}$$

(12)

Include contents data splitting time and the user dose N times device exchange action time, system using FCS method the total time is T_FCS, T_FCS’s equation as (13).

$$T_{FCS}={T^{\prime }}_{\text{}\text{}\text{}cs}+N\ast T_{nc}$$

(13)