|By JCN Newswire||
|April 8, 2014 12:58 AM EDT||
Tokyo, Apr 8, 2014 - (JCN Newswire) - Fujitsu Laboratories Ltd. today announced the development of a technology for accelerating data transfer speeds that can be applied to various types of network environments used for cloud, mobile applications and other services.
Companies are today increasingly positioning their business systems in the cloud and consolidating their servers into datacenters. This is driving rapid growth in data transfer volume between multiple datacenters as well as datacenters and end-user equipment. While specialized hardware or network upgrades could speed up transfers, these are expensive approaches and cannot be easily deployed in cloud, virtual or mobile environments.
Fujitsu Laboratories has now developed a technology that uses data deduplication and compression to reduce the volume of data transfers, enabling dramatically greater data transfer speeds with only software. This technology can increase effective data-transfer rates by 10 times without the added cost of network upgrades, and can boost transfer speeds in a wide range of network environments between cloud datacenters and end-user equipment.
This technology will be exhibited at Fujitsu Forum 2014, running May 15-16 at Tokyo International Forum in Tokyo.
The popularity of cloud services and mobile devices is leading to ever-more applications available over networks that use a variety of communications environments. Every day, companies use datacenters for file transfers, file sharing, backups, and distributing data to mobile devices. Given that the volume of data transfers is expanding daily, there is a growing need to inexpensively accelerate data speeds without network upgrades or deployment of specialized equipment.
Previously, Fujitsu Laboratories conducted R&D on high-speed protocols as a way to accelerate data transfers. This is an effective method when a network's bandwidth is not being used to its full capacity. However, when bandwidth is fully utilized, solving problems such as network delays required network upgrades.
In order to accelerate transfers without upgrading networks, another effective approach is to reduce the volume of data being transferred. There are two techniques for doing this. One is data deduplication, where both sender and recipient save copies of data so that duplicated data transmission can be eliminated. The other is to compress data using file-compression technology. Data deduplication and compression technologies are already used in storage systems and specialized hardware for accelerating data transfers, and are effective in accelerating transfer rates. But implementing these technologies in software so that they can be used with mobile devices, for example, poses the following problems:
- Data deduplication relies on both sender and recipient to save copies of data, and this is difficult to implement on mobile devices that have limited storage capacity.
- Both deduplication and compression are processor-intensive, and on mobile devices that have limited CPU power, these techniques can slow down effective transfer rates.
About the Technology
Fujitsu has now developed high-speed data transfer technology that can effectively boost data transfer speeds even on mobile devices, using software to cut data volumes, leveraging data deduplication and compression technologies. Features of the technology are as follows.
1. High deduplication performance by minimizing storage requirement
Fujitsu Laboratories has developed a technology that selects data that appears with high statistical frequency on the network and prioritizes it for saving. This maintains high deduplication performance while reducing the volume of low-frequency data being saved, so that the limited memory on mobile devices can be used more effectively. In internal testing, this was found to reduce the volume of duplicate data saved in the mobile device's storage by as much as 80%.
2. Lightweight data compression technology
Fujitsu Laboratories has developed a technology that reduces the CPU load imposed by the compression process to as little as one-fourth the level of conventional technologies. This technology searches for repeating patterns that appear within the data. When no pattern is found, it searches at longer intervals. When a pattern is found, data in close proximity is searched in particular detail. This results in efficient searching overall, while greatly reducing the time required for compression.
3. Automatic selection technology for operational improvements
Deduplication and compression of transfer data will at times lower data transfer rates when the size of data to be transferred is small and duplication is rarely found on the data. The net effectiveness of these techniques depends on data size, available network bandwidth, and CPU power. This technology will therefore periodically evaluate these parameters, assess the acceleration benefits, and determine whether deduplication or compression will be effective in practice. This frees system administrators from needing to configure settings for every deployed environment and improves operations.
This newly developed technology is expected to lead to easier use of a variety of network applications in the cloud, and in virtual and mobile environments that are anticipated to continue to become more prevalent. This technology being available as software means that it can be integrated into existing servers and operating systems to bring its benefits to notebook computers, tablets, smartphones, and other mobile devices.
In one possible scenario, a salesman visiting Company A would download sales materials for Company A from headquarters, and then when visiting Company B would download slightly different sales materials for Company B. The parts of these materials that are the same would not need to be re-downloaded, effectively increasing download speeds. Over a 10 Mbps connection of available bandwidth, this has been shown to increase effective transfer rates 10 times.
Fujitsu Laboratories will be conducting practical testing of this technology with the goal of commercializing during fiscal 2014. This will contribute to greater quality with everything from datacenters on wide-area networks to end users on mobile devices.
About Fujitsu Limited
Fujitsu is the leading Japanese information and communication technology (ICT) company offering a full range of technology products, solutions and services. Approximately 170,000 Fujitsu people support customers in more than 100 countries. We use our experience and the power of ICT to shape the future of society with our customers. Fujitsu Limited (TSE: 6702) reported consolidated revenues of 4.4 trillion yen (US$47 billion) for the fiscal year ended March 31, 2013 For more information, please see www.fujitsu.com.
Source: Fujitsu Limited
Fujitsu Limited Public and Investor Relations www.fujitsu.com/global/news/contacts/ +81-3-3215-5259
Copyright 2014 JCN Newswire. All rights reserved. www.japancorp.net
Due of the rise of Hadoop, many enterprises are now deploying their first small clusters of 10 to 20 servers. At this small scale, the complexity of operating the cluster looks and feels like general data center servers. It is not until the clusters scale, as they inevitably do, when the pain caused by the exponential complexity becomes apparent. We've seen this problem occur time and time again. In his session at Big Data Expo, Greg Bruno, Vice President of Engineering and co-founder of StackI...
May. 26, 2015 01:00 AM EDT Reads: 4,354
Once the decision has been made to move part or all of a workload to the cloud, a methodology for selecting that workload needs to be established. How do you move to the cloud? What does the discovery, assessment and planning look like? What workloads make sense? Which cloud model makes sense for each workload? What are the considerations for how to select the right cloud model? And how does that fit in with the overall IT transformation?
May. 26, 2015 12:00 AM EDT Reads: 4,160
The recent trends like cloud computing, social, mobile and Internet of Things are forcing enterprises to modernize in order to compete in the competitive globalized markets. However, enterprises are approaching newer technologies with a more silo-ed way, gaining only sub optimal benefits. The Modern Enterprise model is presented as a newer way to think of enterprise IT, which takes a more holistic approach to embracing modern technologies.
May. 25, 2015 11:00 PM EDT Reads: 5,904
For better or worse, DevOps has gone mainstream. All doubt was removed when IBM and HP threw up their respective DevOps microsites. Where are we on the hype cycle? It's hard to say for sure but there's a feeling we're heading for the "Peak of Inflated Expectations." What does this mean for the enterprise? Should they avoid DevOps? Definitely not. Should they be cautious though? Absolutely. The truth is that DevOps and the enterprise are at best strange bedfellows. The movement has its roots in t...
May. 25, 2015 10:00 PM EDT Reads: 6,197
The true value of the Internet of Things (IoT) lies not just in the data, but through the services that protect the data, perform the analysis and present findings in a usable way. With many IoT elements rooted in traditional IT components, Big Data and IoT isn’t just a play for enterprise. In fact, the IoT presents SMBs with the prospect of launching entirely new activities and exploring innovative areas. CompTIA research identifies several areas where IoT is expected to have the greatest impac...
May. 25, 2015 09:00 PM EDT Reads: 4,731
There is little doubt that Big Data solutions will have an increasing role in the Enterprise IT mainstream over time. 8th International Big Data Expo, co-located with 17th International Cloud Expo - to be held November 3-5, 2015, at the Santa Clara Convention Center in Santa Clara, CA - has announced its Call for Papers is open. As advanced data storage, access and analytics technologies aimed at handling high-volume and/or fast moving data all move center stage, aided by the cloud computing bo...
May. 25, 2015 08:45 PM EDT Reads: 1,349
Every day we read jaw-dropping stats on the explosion of data. We allocate significant resources to harness and better understand it. We build businesses around it. But we’ve only just begun. For big payoffs in Big Data, CIOs are turning to cognitive computing. Cognitive computing’s ability to securely extract insights, understand natural language, and get smarter each time it’s used is the next, logical step for Big Data.
May. 25, 2015 08:00 PM EDT Reads: 1,856
There's no doubt that the Internet of Things is driving the next wave of innovation. Google has spent billions over the past few months vacuuming up companies that specialize in smart appliances and machine learning. Already, Philips light bulbs, Audi automobiles, and Samsung washers and dryers can communicate with and be controlled from mobile devices. To take advantage of the opportunities the Internet of Things brings to your business, you'll want to start preparing now.
May. 25, 2015 07:00 PM EDT Reads: 5,690
The 4th International Internet of @ThingsExpo, co-located with the 17th International Cloud Expo - to be held November 3-5, 2015, at the Santa Clara Convention Center in Santa Clara, CA - announces that its Call for Papers is open. The Internet of Things (IoT) is the biggest idea since the creation of the Worldwide Web more than 20 years ago.
May. 25, 2015 07:00 PM EDT Reads: 1,510
Enterprises are fast realizing the importance of integrating SaaS/Cloud applications, API and on-premises data and processes, to unleash hidden value. This webinar explores how managers can use a Microservice-centric approach to aggressively tackle the unexpected new integration challenges posed by proliferation of cloud, mobile, social and big data projects. Industry analyst and SOA expert Jason Bloomberg will strip away the hype from microservices, and clearly identify their advantages and d...
May. 25, 2015 07:00 PM EDT Reads: 1,310
In a world of ever-accelerating business cycles and fast-changing client expectations, the cloud increasingly serves as a growth engine and a path to new business models. Dynamic clouds enable businesses to continuously reinvent themselves, adapting their business processes, their service and software delivery and their operations to achieve speed-to-market and quick response to customer feedback. As the cloud evolves, the industry has multiple competing cloud technologies, offering on-premises ...
May. 25, 2015 06:00 PM EDT Reads: 3,942
The 5th International DevOps Summit, co-located with 17th International Cloud Expo – being held November 3-5, 2015, at the Santa Clara Convention Center in Santa Clara, CA – announces that its Call for Papers is open. Born out of proven success in agile development, cloud computing, and process automation, DevOps is a macro trend you cannot afford to miss. From showcase success stories from early adopters and web-scale businesses, DevOps is expanding to organizations of all sizes, including the...
May. 25, 2015 05:30 PM EDT Reads: 3,924
Over the years, a variety of methodologies have emerged in order to overcome the challenges related to project constraints. The successful use of each methodology seems highly context-dependent. However, communication seems to be the common denominator of the many challenges that project management methodologies intend to resolve. In this respect, Information and Communication Technologies (ICTs) can be viewed as powerful tools for managing projects. Few research papers have focused on the way...
May. 25, 2015 05:00 PM EDT Reads: 1,666
As the world moves from DevOps to NoOps, application deployment to the cloud ought to become a lot simpler. However, applications have been architected with a much tighter coupling than it needs to be which makes deployment in different environments and migration between them harder. The microservices architecture, which is the basis of many new age distributed systems such as OpenStack, Netflix and so on is at the heart of CloudFoundry – a complete developer-oriented Platform as a Service (PaaS...
May. 25, 2015 05:00 PM EDT Reads: 1,538
In high-production environments where release cycles are measured in hours or minutes — not days or weeks — there's little room for mistakes and no room for confusion. Everyone has to understand what's happening, in real time, and have the means to do whatever is necessary to keep applications up and running optimally. DevOps is a high-stakes world, but done well, it delivers the agility and performance to significantly impact business competitiveness.
May. 25, 2015 05:00 PM EDT Reads: 1,823