higher5fh/rsr-net-custom-weights

Recursive Semantic Refinement Network (RSR-Net)

Project Goal

The Recursive Semantic Refinement Network (RSR-Net) is an innovative approach to abstractive summarization. Instead of generating text word-by-word, RSR-Net is designed to iteratively refine a fixed-size semantic embedding of a summary until it converges to the desired output state, which is semantically close to the ground-truth summary (Iterative regression problem in a semantic space). This technique leverages principles from Deep Equilibrium Models (DEQ) and Recurrent Neural Networks (RNNs).

Refer Recursive_Semantic_Refinement_Network_(RSR_Net).ipynb for more detailed mathematics and implementation

Dataset:

The CNN / DailyMail Dataset is an English-language dataset containing just over 300k unique news articles as written by journalists at CNN and the Daily Mail. The current version supports both extractive and abstractive summarization, though the original version was created for machine reading and comprehension and abstractive question answering.

!wget -c https://huggingface.co/datasets/ccdv/cnn_dailymail/resolve/main/cnn_stories.tgz
!wget -c https://huggingface.co/datasets/ccdv/cnn_dailymail/resolve/main/dailymail_stories.tgz

Model Architecture

State	Role	Dimension (Adjusted)
Input ($\mathbf{x}$)	Document Context (Fixed for all steps)	768 BART d_model
State ($\mathbf{y}$)	Current Summary Embedding (Refined output)	768 BART d_model
Latent ($\mathbf{z}$)	Internal Memory (Accumulates context)	64 latent-dim
Combined Input	torch.cat([x,y,z])	768 + 768 + 64

Training

Epochs = 20

Mean State and Confidence Value per Epoch

Prediction on the first batch of data

Preconditioning step 1/2:
  Current y (detached): 0.008832002989947796
  Current z (detached): 0.1603105664253235
Preconditioning step 2/2:
  Current y (detached): 0.008966365829110146
  Current z (detached): 0.18550479412078857
Final step 3/3:
  Final y_hat: 0.008964473381638527
  Final q_hat: 0.9251689910888672
Predicted embedding shape: torch.Size([8, 768])
Prediction confidence: tensor([0.9227, 0.9260, 0.9273, 0.9234, 0.9237, 0.9261, 0.9256, 0.9265],
       device='cuda:0')
['The lead singer of the popular British band McFly decided it was time to have a new very young member. To welcome his baby into the world he decided to create a time lapse of his wife\'s pregnancy to the tune of an original song.\n\n\'We took photos every day through the 9 months of our pregnancy, this is the result (plus a little song I wrote called "Something New")\' writes Tom Fletcher on his Youtube on which he posted the video \'From Bump to Buzz\'\xa0 of his gradually growing wife Giovanna who gave birth on Thursday.\n\nThe viral video from Bump to Buzz has over 1 million views, and one of those viewers, Buzz Michelangelo Fletcher, is fresh from the womb.\n\nSCROLL DOWN FOR VIDEO\n\nBuzz Michelangelo Fletcher was born this Thursday and his parents Tom and Giovanna documented the entire journey leading up to his birth\n\nIn this first snapshot of Giovanna her slim frame makes it hard to tell she\'s got a baby brewing inside her belly\n\nGiovanna starts to show signs of pregnancy as Tom continues his belly warming song\n\nOn Thursday the couple welcomed into the world and shared the news on their respective Twitter accounts.\n\n\'Sorry for my twitter silence over the last 24hrs, I’ve been far too busy cuddling my son… :)\' said Tom Fletcher.\n\n\'THRILLED to announce the safe arrival of our little BOY! Born last night at 7pm. I can’t stop staring at and kissing him! I’m in love! Xxx\' wrote his wife Giovanna.\n\nAnd to really let his fans know what it\'s like to have a baby he wrote, \'And he’s on his 3rd nappy. Full of poop, that’s my boy!\'\n\n\'And yes I\'m being completely serious, my son is called Buzz :D,\' he wrote to fans who were commenting on his child\'s new title.\n\nFletcher is no stranger to writing original songs for his beloved wife Giovanna. Some may remember the wedding speech he wrote to Giovanna on their special day in May of 2012. That video has 11,420,979 views.\n\nFletcher then decided to write a little tune for their birth announcement and decided to make the song writing for important life moments a tradition.\n\nParentdish.com reports that Tom and Giovanna met when they were both teenagers at the Sylvia Young Theater School where they were both students.\n\nThe high school sweethearts are now internationally adored and will continue to grow for all the world to see.\n\nGiovanna looks as though she\'s about to pop towards the song\'s final verses\n\nWhen it\'s time to give birth, Giovanna fades out and waves goodbye\n\nGiovanna returns with her son Buzz and Tom smiles at the camera happier than ever\n\n@highlight\n\n\'We took photos every day through the 9 \nmonths of our pregnancy, this is the result (plus a little song I wrote \ncalled "Something New")\' writes Tom Fletcher on his Youtube\n\n@highlight\n\nBaby Buzz Michelangelo Fletcher was born on Thursday\n\n@highlight\n\nThe viral video from Bump to Buzz has over 1 million views\n\n@highlight\n\nTom Fletcher wrote a wedding speech dong for his wife Giovanna back in 2012 and it got 11, 420, 929 views', "Solar 'super-storms' pose a 'catastrophic' and 'long-lasting' threat to life on Earth, a scientist has warned.\n\nThese huge storms are caused by violent eruptions on the surface of the sun and are accompanied by coronal mass ejections, or CMEs.\n\nCMEs are the most energetic events in our solar system - involving huge bubbles of plasma and magnetic fields being spewed from the sun’s surface into space.\n\nScroll down for video\n\nSolar 'super-storms' pose a 'catastrophic' and 'long-lasting' threat to life on Earth, a scientist has warned. A solar eruption could take out the National Grid, along with many electrical systems across the world\n\nThey are often preceded by a solar flare - a massive release of energy from the sun in the form of gamma rays, X-rays, protons and electrons.\n\nA solar superstorm occurs when a CME of sufficient magnitude tears into the Earth’s surrounding magnetic field and rips it apart.\xa0\n\nSuch an event would induce huge surges of electrical currents in the ground and in overhead transmission lines, causing widespread power outages and severely damaging critical electrical components.\n\nAshley Dale, who was a member of an international task force - dubbed Solarmax - set up to identify the risks of a solar storm and how its impact could be minimised, warned of the danger man faces from 'solar super-storms.'\n\nA solar superstorm occurs when a CME of sufficient magnitude tears into the Earth’s surrounding magnetic field and rips it apart\n\nMr Dale, carrying out doctoral research in aerospace engineering at Bristol University, said it is only a 'matter of time' before an exceptionally violent solar storm is propelled towards Earth.\n\nHe says such a storm would wreak havoc with communication systems and power supplies, crippling vital services such as transport, sanitation and medicine.\n\nSolar flares can damage satellites and have an enormous financial cost.\n\nAstronauts are not in immediate danger because of the relatively low orbit of this manned mission. They do have to be concerned about cumulative exposure during space walks.\n\nThe charged particles can also threaten airlines by disturbing the Earth’s magnetic field.\n\nVery large flares can even create currents within electricity grids and knock out energy supplies.\n\nA positive aspect, from an aesthetic point of view, is that the auroras are enhanced.\n\nGeomagnetic storms are more disruptive now than in the past because of our greater dependence on technical systems that can be affected by electric currents.\n\n'Without power, people would struggle to fuel their cars at petrol stations, get money from cash dispensers or pay online,' he said.\n\n'Water and sewage systems would be affected too, meaning that health epidemics in urbanised areas would quickly take a grip, with diseases we thought we had left behind centuries ago soon returning.'\n\nThe largest ever solar super-storm on record occurred in 1859 and is known as the Carrington Event, named after the English astronomer Richard Carrington who spotted the preceding solar flare.\n\nThis massive CME released about 1022 kJ of energy - the equivalent to 10 billion Hiroshima bombs exploding at the same time - and hurled around a trillion kilos of charged particles towards the Earth at speeds of up to 3000 km/s.\n\nHowever, its impact on the human population was relatively benign as our electronic infrastructure at the time amounted to no more than about 124,000 miles (200,000 km) of telegraph lines.\n\nMr Dale makes it clear in the latest issue of Physics World that these types of events are not just a threat, but inevitable.\n\nNasa scientists have predicted that the Earth is in the path of a Carrington-level event every 150 years on average.\xa0\n\nThis means that we are currently five years overdue - and that the likelihood of one occurring in the next decade is as high as 12 per cent.\n\nThis image of a huge solar flare (top left) was captured by the Solar Dynamics Observatory (SDO). One of the most dramatic features is the way the entire surface of the sun seems to ripple with the force of the eruption\n\nThe 40-strong international team of scientists from Solarmax gathered at the International Space University in France last year to identify the best ways of limiting the potential damage of a solar super-storm.\n\nA sub-group of scientists concluded that advanced space-weather forecasting is the best solution, which could be achieved by sending an array of 16 lunchbox-sized cube satellites into orbit around the Sun.\n\nThe network could give around a week’s notice of where, when and with what magnitude solar storms will take place, providing adequate time to switch off vulnerable power lines, re-orientate satellites, ground planes and begin national recovery programmes.\n\nMr Dale’s own solution is to design spacecraft and satellites so that the sensitive, on-board instruments are better protected again sudden increases in radiation from solar storms.\n\nHe suggests redistributing the existing internal architecture of a craft so that sensitive payloads are surrounded by non-sensitive bulk material such as polyethylene, aluminium and water.\n\nMr Dale added: 'As a species, we have never been more vulnerable to the volatile mood of our nearest star, but it is well within our ability, skill and expertise as humans to protect ourselves.'\n\n\xa0\n\n@highlight\n\nHuge storms are caused by violent eruptions on the surface of the sun\xa0\n\n@highlight\n\nThey can induce surges of electrical currents in the ground on Earth\n\n@highlight\n\nA storm can also affect overhead transmission lines causing a black out\n\n@highlight\n\nWarning comes from, Ashley Dale, a member of the Solarmax task force\xa0\n\n@highlight\n\nSolarmax was set up to find out how to reduce the impact of solar storms\n\n@highlight\n\nMr Dale says it is only a 'matter of time' before an exceptionally violent solar storm is propelled towards Earth", "On paper it looks like the holy trinity of an attacking midfield, but Louis van Gaal's decision to play Adnan Januzaj and Angel di Maria either side of Juan Mata on Monday night may not be one he makes again.\n\nDespite 90 minutes of nail-biting action, the first 30 minutes were most telling, and set the tone for the remainder of the game while summing up Manchester United's season so far.\n\nWest Bromwich Albion dominated United for the opening period, leading the game at the half-hour mark and leading every physical battle to boot.\n\nMORE HEAT MAPS AND STATS FROM SPORTSMAIL'S MATCH ZONE SERVICE HERE\n\nAngel di Maria started on the left wing for Manchester United, providing the assist for Marouane Fellaini\n\nDi Maria caused problems on the left, and often moved infield to penetrate West Brom's defence\n\nPart of the problem was the load on midfielder Daley Blind as United attempted to spring forward using the three-pronged attacking midfield of Januzaj, Mata and Di Maria.\n\nJanuzaj, starting his first game under Van Gaal and not known for his defensive capabilities, was cemented to the right wing for the first-half, moving slightly inward in the second-half as United improved ever so slightly.\n\nMata, playing in the absence of the suspended Wayne Rooney, saw very little of the ball throughout, and was bypassed by United's deeper midfielders and defence.\xa0\n\nMORE HEAT MAPS AND STATS FROM SPORTSMAIL'S MATCH ZONE SERVICE HERE\xa0\n\nJuan Mata started in the middle of the three-pronged attacking midfield at the Hawthorns\n\nMata spent much of the first-half helping Adnan Januzaj on the right of midfield, and struggled to impact\n\nOn the opposite wing Di Maria was not an individual problem. In fact the Argentine was superb again, providing the assist for Marouane Fellaini's equaliser and delivering several dangerous balls having found himself in space.\n\nHe did exactly what Januzaj didn't when 'stuck out' on the wing - making use of the situation to full effect - with the Belgian picking up a 5.5/10 rating bySportsmail. Di Maria at least attempted to move in and penetrate the penalty area more than once, as shown in his heat map.\n\nMata, meanwhile, is an ongoing dilemma - a £37.5million midfielder without a defined place in Van Gaal's system to justify the price tag - and it showed again at the Hawthorns.\n\nMORE HEAT MAPS AND STATS FROM SPORTSMAIL'S MATCH ZONE SERVICE HERE\xa0\n\nJanuzaj, on his first start for United under Van Gaal, hardly had an effect on the game on the right wing\n\nThe Belgian hugged the right wing for United, and his delivery into the box was often poor\n\nThe only man directly between Mata and goal, striker Robin van Persie, was given no support by the Spaniard and nothing to feed off. The two played too far apart, forcing (or enabling, Van Gaal would argue) United to use the flanks even more.\xa0\n\nToo wide and not clinical enough, United were stretched.\xa0Space behind the striker that Rooney would often fill was vacant, meaning United struggled to win the ball high up the pitch.\xa0\n\nAlbion's only roadblock to goal when winning the ball in midfield was an out-of-position Ander Herrera and an exposed Blind.\n\nThe Januzaj-Mata-Di Maria trio made just one tackle between them, compared to five by West Brom's attacking midfield three of Chris Brunt, Stephane Sessegnon and Graham Dorrans.\n\nIt was no surprise both goals came on the break with the  trio chasing shadows, and the second goal in particular cut through the heart of United, as can be seen below.\n\nMORE HEAT MAPS AND STATS FROM SPORTSMAIL'S MATCH ZONE SERVICE HERE\xa0\n\nWest Brom's second goal, scored by Saido Berahino (18) came from United being cut right down the middle\n\nFellaini was brought on for the second half and had a big impact on the match, scoring the equaliser\n\nVan Persie was often playing off the last West Brom man, but Mata struggled to connect with him\n\nVan Gaal got his tactics wrong at 8pm, but the game quickly changed complexion after the first-half.\n\nAs is not often the case, there weren't too many question marks over Fellaini's introduction at the expense of Herrera at half-time, giving Blind more physical support. It worked in an attacking sense, too.\n\nUnited finally had some control going forward, but none when tracking back. Two goals each was a rather predictable scoreline.\n\nBerahino celebrates putting West Brom ahead in the second half at the Hawthorns\n\nLouis van Gaal's side looked better attacking than defending, and not for the first time this season\n\n@highlight\n\nLouis van Gaal played Adnan Januzaj to the right and Angel di Maria to the left of Juan Mata in the 2-2 draw at the Hawthorns\n\n@highlight\n\nDi Maria was superb with his delivery and utilised the wing, but both Januzaj and Mata failed to have an impact\n\n@highlight\n\nManchester United were stretched and too wide, putting pressure on Daley Blind and the defence in the first-half as West Brom dominated\n\n@highlight\n\nJanuzaj was starting his first game for United under Van Gaal\n\n@highlight\n\nMata also struggled to connect with United striker Robin van Persie\xa0\n\n@highlight\n\nMORE HEAT MAPS AND STATS FROM SPORTSMAIL'S MATCH ZONE SERVICE HERE\xa0", "By \nDaily Mail Reporter\n\nPUBLISHED:\n\n20:10 EST, 8 June 2012\n\n\n| \n\nUPDATED:\n\n02:18 EST, 11 June 2012\n\nPrince William and Kate shocked cinema goers in London by casually joining a queue to see The Avengers.\n\nAttempting to merge in with the crowd, the Royals were dressed down and were almost unrecognisable at a glance.\n\nKate wore blue skinny jeans, heels and a denim jacket, and the second in line to the Throne wore\xa0 a shirt, blue jumper, glasses and a baseball cap.\n\nDuke & Duchess of Cambridge, Prince William and Kate try to merge in with the queue at a South Kensington cinema\n\nOne excited fan at the Odeon Kensington cinema, on Thursday, couldn't contain her excitement and tweeted: 'OMG watching the Avengers with Kate middleton and Prince william sitting right next to me!!!!!'\n\nThe Royals were enjoying time relaxing after four days of public events to celebrate the Queen's Diamond Jubilee, including taking part in the Royal Flotilla and attending a live concert outside Buckingham Palace.\n\nAfter relaxing with Kate at the cinema, Prince William and Harry visited the Duke of Edinburgh in hospital to lift his spirits after the Palace confirmed he won't be be out in time celebrate his 91st birthday on Sunday at home.\n\nPrince William and Kate were almost unrecognisable at the cinema compared with their formal dress during the Jubilee celebrations last weekend\n\nIt seems that the Duke of Edinburgh faces spending the weekend in hospital as he continues to recover from a bladder infection that has laid him low since Monday.\n\nPhilip's grandsons paid him a 'short private visit' just before 5pm after the news was released earlier today, Clarence House said.\n\nMeanwhile, as the Euro 2012 championship gets under way, the Princes announced on Friday they are boycotting the event in Ukraine amid concerns about the treatment of the opposition leader.\n\nTheir decision follows the news that minsters are to boycott England’s opening Euro 2012 matches over human rights abuses in Ukraine.\n\nThe Foreign Office said it would not send any minister to England’s group-stage matches in protest at the plight of glamorous Ukrainian opposition leader Yulia Tymoshenko, who was jailed after a ‘show trial’.\n\nPrince William, The Duke of Cambridge, and Prince Harry outside the King Edward VII hospital in Central London after visiting their grandfather The Duke of Edinburgh on Friday\n\n@highlight\n\nRoyal couple spend night relaxing together watching the Avengers in Kensington cinema\n\n@highlight\n\nNext day William visits the Duke of Edinburgh in hospital with Prince Harry", "Bravo hit Southern Charm has introduced a new cast member this season, after quietly firing original cast member Jenna King at the end of Season One.\n\nLandon Clements is introduced in Season Two, which began airing last week, as an old friend of Shep’s who has moved back to Charleston in the wake of her divorce from an unnamed British man who she lived with \xa0in Los Angeles.\n\nAnd Dailymail.com can reveal that not only is her ex-husband James Maby also the ex-husband of Clueless actress Stacey Dash, he was also once the star of a reality show.\n\nLandon, 33, was born Ansley Landon Clements in Georgia. After going to the College of Charleston (during which time she met Southern Charm castmate Shep Rose) she moved to Telluride, Colorado to ski and met James Maby when she was 24.\n\nScroll down for video\xa0\n\nThe Southern Charm cast photo for Season Two includes one new face, Landon, seen here in the white dress\n\nLandon claims she was swept off her feet by a self-proclaimed ‘James Bond Brit.’ After they met, they got married in Charleston and then she moved with him to Los Angeles. She never names him on the show or on the Bravo website, but she shared a few photos on the series' second episode\n\nThe pair were together for seven years, she told Southern Charm cameras, while photos showed snippets of their glamorous time together.\xa0\n\nBut she said it was also terribly lonely, so lonely that she left him and California behind.\n\n‘I was living the dream. We had a house in the [Hollywood] Hills, swimming pool, staff, the cars, the jewels. When I moved out of the house I pretty much just walked away from all of it….\xa0\n\n'On the inside I was so alone, so I packed up and left. Sometimes you just have to save yourself,' she told the camera as she choked back tears.\n\nNo more bling: ‘I was living the dream. We had a house in the  Hills, swimming pool, staff, the cars, the jewels,' Landon said on Southern Charm. She shared this photo of an impressive looking engagement ring, right\n\nMaby's first wife Stacey Dash, seen left in 1995's Clueless, had a sizable looking diamond ring herself in 2005, at right, which was around the time she married to Maby after giving birth to their daughter\n\nMaby, 43, is an Etonian who claims to speak five languages and was married to Stacey Dash from 2005 to 2006.\xa0\n\nThe pair share a daughter Lola, 11, together. He is the CEO of Sports Logistics, an international firm which does sport branding and billboards and travels a lot for his job.\n\nFrom Landon’s bio on the Bravo website it would seem there isn't a lot of love lost between the pair, as she branded him in part an 'international man of not much mystery.'\xa0\n\nAn excerpt reads:\n\n‘During this time she met a self-proclaimed ‘James Bond Brit.’ The international man of not much mystery swept her off her feet and they married in Charleston. The demands of their careers compounded with the duties for his actress ex-wife and young daughter became too much for the pair and they separated.’\n\nThe bio never names him or Dash.\xa0\n\nBut then she choked up while telling the cameras about her live with James Maby. Despite the sunny Los Angeles weather, Landon says her life was incredibly lonely\xa0\n\nMaby's life in Los Angeles also includes daughter Lola, 11, whom he had with ex-wife Stacey Dash. One time Clueless star Dash, who has been married three times, also has son Austin, 23, pictured at right with his mom and sister\n\nAfter Landon and James pair split in 2013, Landon spent the winter in Aspen and arrived back in Charleston to ‘reclaim her life’ in 2014 – coincidentally just in time to join the Bravo show which filmed last summer.\n\nBut Landon doesn't just have friends on reality shows already. Lke Shep, she has an ex-husband with plenty of experience himself, and she no doubt knew more than most what she would be getting into by joining the Bravo hit.\n\nHer ex-husband James Maby was a repeat winner on the largely forgotten British reality show Lost, which aired for just one season the fall of 2001.\n\nOn Lost two strangers were paired together, given almost no money and just three days' rations, and were parachuted while blind folded into an unknown destination - including Azerbaijan and Mali.\n\nAll they knew was their final destination, and they had to find there way to it.\xa0\n\nLandon's ex James Maby as seen on the opening credits, in 2001, from the British reality show Lost\n\nOn the show Maby and his teammate, an until-the-show stranger named Harriet Bulwer-Long, were dropped alongside two other teams in an unknown destination with little food or money. Here they take their blindfolds off upon being left in Newfoundland\n\nHe worked his posh accent and knowledge of languages to his advantage. His team also had the benefit of his family apartment on Fifth Avenue, where they stayed one night while passing through New York with no money, seen right. That apartment was sold in 2004, before he met Landon\n\nOne episode saw James negotiating the price of his camel ride to Timbuktu, seen here, before complaining that the saddle hurt his privates\n\nMaby was also rampant flirt and a charmer during his time on the show, smiling when the women here answered that he was\n\nHe won multiple times, and celebrated each time with the classic champagne pop and crowd spray upon reaching Trafalgar Square\n\nEach race contained three teams, and each team had a cameraman in tow. On all but the season finale the teams were competing to be first back to London's Trafalgar Square.\n\nThey had to beg and borrow and talk their way into freebies - including plane tickets - to survive.\n\nMaby, who skis and claims to speak five languages, thrived.\xa0\n\nThe first team back to Trafalgar Square won, and got to go on the adventure again. Maby won multiple rounds and featured prominently throughout the season.\n\nCameras followed as he and show partner Harriet Bulwer-Long\xa0traversed on camel back to Timbuktu, found his way out of Newfoundland, and borrowed money off old school friends in New York where his father conveniently had an apartment on Fifth Avenue.\xa0\n\nAs a repeat winner he had a large amount of screen time, but he receded from the spotlight when the show went off the air.\n\nNo doubt he would have good advice for his ex on how to win over viewers on reality television if the pair still speak.\n\nBut it's unclear if they are on speaking terms, and Maby appears to have bounced right back from his second divorce and into a new relationship.\xa0\n\nAs of August 2013 his Facebook status has been ‘in a relationship’ with Kam Heskin, 41, a sometime actress and publicist for jewelry companies.\n\n\xa0Maby seems to have moved on from Landon with no problem. In August 2013 Kam Heskin proclaimed them 'in a relationship' when she posted these two photos\n\n\xa0\n\n@highlight\n\nLandon Clements is a new cast member on Southern Charm\n\n@highlight\n\nShe is 'reclaiming' her life after a divorce from an unnamed man\n\n@highlight\n\nHer ex is British exec James Maby - \xa0she lived with him in Los Angeles\n\n@highlight\n\nHe had a daughter in 2004 with Stacey Dash, to whom he was briefly wed\n\n@highlight\n\nIn 2001 Maby starred in and won the British reality competition show Lost\xa0", 'Google isn’t the only firm looking to create phones that can be upgraded, rather than replaced.\n\nThe Puzzlephone lets owners swap parts in and out of the handset either when they break, or when a better version of that particular module is released.\n\nThe Finnish firm behind the plans is currently testing prototypes of the device, and hopes to release the handsets by the second half of 2015.\n\nScroll down for video\xa0\n\nThe Puzzlephone (pictured) from Finnish-based Circular Devices lets owners swap parts in and out of the handset either when they break, or when a better version of that particular module is released\n\nCircular Devices began working on the project in 2013.\n\nEach Puzzlephone is based around three elements - the Spine, Heart and Brain.\n\nThe phone’s LCD display, microphone, main buttons and speakers connect to the Spine.\n\nIts Heart contains the battery and so-called secondary electronics, while the Brain is where the camera and processor is kept, alongside the main circuitry of the device.\n\nEach of these three segments can be slid out of the core, and replaced with another.\n\nAccording to the developer kit, Ara phones will be able run on multiple batteries - when one battery dies, it can be detached and replaced with a full battery module.\n\nEach phone \nwill have a central \'spine\' and an endoskeleton - nicknamed \'endo\' - \nmade of ribs that the individual modules will clip on to.\n\nThere will be three different sized \nendos - including mini, medium and large - to rival the existing range of \nphones currently on the market, from compacts to phablets.\xa0\n\nLarger phones will be able to accomodate either larger, or additional modules, than the mini will.\n\nGoogle\'s kit describes various modules including batteries, Wi-Fi and Bluetooth chips, cameras, speakers and more.\n\nIn theory, any sensor that can be fitted to a module will be able to attach to a module and while Google will make the shell, these modules will be made by other companies.\xa0\n\nBy printing their own parts, users will also be able to customise them.\n\nCircular Devices recently commissioned Rauno Huttunen and his team at Versoteq to create the prototype, which was printed using a 3D printer.\n\n‘As we are facing ever greater challenges of increasing consumption and decreasing resources,’Circular Devices\xa0explained, \'we need new solutions. We need mobile standards that enable resource efficiency as well as platforms for hardware innovation.\n\n\'When one part of the phone needs repair or upgrade there is no need to replace the entire device.\n\n\'Puzzlephone was established to create that change - to create a mobile industry that is both ecologically and socially sustainable.\'\n\nMr Huttunen added: \'We liked the openness of Puzzlephone, and the modularity of it and we can use it to demonstrate the capabilities of 3D printing.\'\n\nIn addition to switching out the hardware modules, Puzzlephone’s operating system will also be customisable.\n\nIn the future, the firm said it will release Puzzlephone standards to developers and manufacturers so they can use the concepts in their own devices.\n\nCircular Devices plans to release the first Puzzlephone during the second half of 2015. It is currently seeking funding for the device, and is testing the prototype.\n\nIn October,\xa0Google unveiled the first working prototype of its own modular phone called Spiral 1.\n\nIn a video, an engineer is shown turning on the device, unlocking it and launching an app during a video filmed at NK Labs in Boston.\n\nIndividual modules are shown being added to, and removed, from the handset including the\xa0LED module, battery, processor, speaker, and a USB port.\xa0\n\nEach Puzzlephone is based around three elements - the Spine, Heart and Brain.The phone’s LCD display, microphone and speakers connect to the Spine.\xa0Its Heart contains the battery, while the Brain is where the camera and processor is kept. Each of these segments can be slid out of the core, and replaced with another\n\nPuzzlephone is similar to the modular phone being built by Google\'s Project Ara. Dubbed Spiral 1, the device (pictured) is demonstrated during a video filmed at NK Labs in Boston. Individual modules are shown being added to, and removed, from the handset including the battery, processor, speaker, and a USB port\n\n\'The first step is figuring out how is this is going to work,\' explained the creative agency.\xa0\n\n\'What are going to be the functions of the different parts of the system? And then from there, we select specific components and draw schematics.\'\n\n\'Once you have a layout, you get the boards fabricated.\n\n\'It’s magical when you open up the box and say "oh my goodness, that’s the thing we’ve spent all these months designing.\'\n\nThe firm said that when the power is applied for the first time to the modules, it\'s what is known as the Smoke Test.\n\n\'Your primary thought at that point is, is this thing going to start smoking?\' continued the engineer.\xa0\n\nIn the video, an engineer is also shown turning on the device (pictured), unlocking it and launching an app.\xa0According to the developer kit files released in April, Ara phones will be able run on multiple batteries - when one battery dies, it can be detached and replaced with a full battery module\n\n\'Is it going to overheat? Is there some critical error or not? And then, once we have the individual pieces working we put them into the complete system.\'\n\nIn the video, a board is shown fitted with connectors. The designers then demonstrate sliding the components in and out.\n\nIn the Spiral 1 prototype, 50 per cent of the phone is taken up by the modules, but Toshiba has made custom chips for Spiral 2, which the company said will increase the amount of space on the device.\n\nSpiral 2 will be demonstrated at a developer’s conference on 14 January.\n\nAccording to the developer kit files released in April, Ara phones will be able run on multiple batteries - when one battery dies, it can be detached and replaced with a full battery module.\n\nIn the Spiral 1 prototype, (platform concept pictured) 50 per cent of the phone is taken up by the modules, but Toshiba has made custom chips for Spiral 2, which the company said will increase the amount of space on the device.\xa0Spiral 2 will be demonstrated at a developer’s conference on 14 January\n\nEach phone will have a central \'spine\' and an endoskeleton that individual modules will clip on to. There will be three different sized endos - mini, medium and large (pictured)\n\nLower-resolution cameras can be swapped with higher-res versions, and users will be also be able to 3D print replacement parts.\n\nBy printing their own parts, users will also be able to customise them.\n\nThe files also revealed each phone will have a central \'spine\' and an endoskeleton - nicknamed \'endo\' - made of ribs that the individual modules will clip on to.\n\nThis spine is shown in the Phonebloks video at NK Labs. \xa0\n\nThere will be three different sized endos - including mini, medium and large - to rival the existing range of phones currently on the market, from compacts to phablets.\n\nLarger Ara phones will be able to accomodate more modules than the mini will, for example.\n\nGoogle\'s kit describes various modules including batteries, Wi-Fi and Bluetooth chips, cameras, speakers and more.\n\nIn theory, any sensor that can be fitted to a module will be able to attach to an Ara device, and while Google will make the shell, these modules will be made by other companies.\n\n@highlight\n\nPuzzlephone concept is based on three elements - Spine, Heart and Brain\n\n@highlight\n\nDisplay and speakers fit to the Spine, the battery attaches to the Heart, and its Brain features the processor and camera\n\n@highlight\n\nCircular Devices plans to release the first Puzzlephone in 2015\n\n@highlight\n\nIt uses similar principles being developed by Google’s Project Ara\n\n@highlight\n\nPrices for the Puzzlephone have not yet been announced\xa0\xa0', "By \nDaily Mail Reporter\n\nPUBLISHED:\n\n15:42 EST, 28 May 2013\n\n\n| \n\nUPDATED:\n\n15:42 EST, 28 May 2013\n\nThe last of the American World War I veterans have described the perils of war, the emotional toll of fighting and the celebration of the armistice in a new book spotlighting their stories.\n\nAuthor Richard Rubin spent 10 years compiling information for his book, The Last of the Doughboys, tracking down numerous veterans, all in their 100s, and traveling across the country to meet them.\n\nEach of the subjects featured in Mr Rubin's book have since passed away. The last World War I veteran, Frank Buckles, died in 2011.\n\nDoughboys: The last of the American World War I veterans have described the perils of war, the emotional toll of fighting and the celebration of the armistice in a new book spotlighting their stories\n\nAs he tried to track down the former soldiers, he was often met with disappointment, finding out that the man or woman he was looking to speak with was no longer alive.\n\nRubin told NPR that on one occasion, he discovered a 108-year-old vet who was alive and 'clear-minded,' but when Rubin showed up two weeks later, the man was unconscious in the hospital\n\nHe died the next day.\n\nBut dozens more were alive, well and willing to share their stories.\n\nThere was Arthur Fiala, who was 106 when he spoke to Mr Rubin. Mr Fiala spoke of his eagerness to pack his bags and join the Allies.\n\nAnticipation: Arthur Fiala, who was 106 when he spoke to Mr Rubin, spoke of his eagerness in his youth to pack his bags and join the Allies\n\nMr Fiala, who was from Wisconsin, said: 'I \nwent to Green Bay and enlisted in the army. And the big war was on then.\nI said I want to get over to France quick.\n\n'You pick out the place where\nyou want me to go. The place where I can be. Wherever I can be used, \nthat's where I want to go.'\n\nAnthony Pierro, 107 at the time of his interview with Rubin, disagreed, saying that the Army is 'a miserable life.'\n\nHe said: 'You can't do anything... on your own. They tell you what to do.'\n\nAt one point, Mr Pierro said the best part of his time in World War I was being in the French city of Bordeaux.\n\nTrouble with war: Anthony Pierro, 107 at the time of his interview with Mr Rubin, disagreed, saying that the Army is 'a miserable life'\n\n'The girls used to say, 'upstairs, two dollars.'\n\nBut you didn't go upstairs, his nephew Rick interjected.\n\n'I didn't have the two dollars.' Mr Pierro replied.\n\nHoward Ramsey, who was 105 when he spoke to Mr Rubin in 2003, said that he and his colleagues were at one time so ill-prepared for the cold that they resorted to sleeping in a cemetery.\n\nHe said:\xa0 'So I remember one \nnight, it was cold, and we had no blankets, or nothing like that. We had\nto sleep.\n\n'We slept in the cemetery, because we could sleep between the\ntwo graves, and keep the wind off of us.'\n\nRecollections: Howard Ramsey, who was 105 when he spoke to Mr Rubin in 2003, said that he and his colleagues were at one time so ill-prepared for the cold that they resorted to sleeping in a French cemetery\n\nCourage under fire: J. Laurence Moffitt, 106 at the time of this interview said he and his colleagues 'lived' under enemy fire, and 'disregarded it' after a while\n\nWhen asked whether he came under artillery fire often during WWI, J. Laurence Moffitt, 106 at the time, replied: 'All the time. We lived under it... After a while, you disregarded it.'\n\nMr Moffitt added that he had been 'severely gassed several times - but I never went to medical for it.'\n\nWilliam J. Lake, who was 107 when he sat down with Mr Rubin, perhaps came the closest to losing his life during the war in one of the most poignant stories told.\n\nMr Lake also fought at the Meuse-Argonne offensive, the deadliest battle in American history.\n\n'Well I'll tell ya, just bullets zipping around you all the time,' he said. 'You \njust never knew when you was going to get hit. but I was lucky.'\n\nHe told Mr Rubin: 'Another guy and I were sitting on a bank and a sniper shot him \ninstead of me... We was no more than two feet apart and he picked him \ninstead of me. He killed him of course.'\n\nLucky one: William J. Lake, who was 107 when he sat down with Mr Rubin, talked about how he was sitting with a fellow soldier when he was suddenly shot by a sniper. He said that the shooter 'picked him instead of me'\n\nHe said that the allied forces later found the shooter in a tree and [killed] him.\n\n'Oh yeah. They didn't take [snipers] prisoner.'\n\nHildegarde Schan, at 107, saw a different side of the war as a young woman.\n\nAfter working for the War Department in Washington, she was worked for the Veterans Bureau in New York after the armistice.\n\nIt was the place where those who had served in the war went to collect their paychecks - and often received bad news.\n\nEmpathy: Hildegarde Schan, at 107, saw a different side of the war as a young woman, dealing with returning soldiers - some without arms or legs - looking to get paid by the Veterans Bureau\n\nSickness: Reuben Law - 105 at the time of the interview -- said he was apart of a convoy en route to France in 1918 when a deadly flu epidemic struck\n\nShe told Rubin: 'It was very sad... You see them coming in with one leg or one arm... I couldn't take it anymore - to see them come in.\n\nShe added: 'They'd borrow on their check and they'd have to pay it back next month and they didn't have any money then.'\n\nWhen the war ended with Armistice Day on November 11, 1918, George Briant wasn't celebrating. In fact, he was mourning.\n\nHe said that he had seen a group of men \ntake shelter in a wooded area before it was shot up by enemy soldiers, \nkilling most of them.\n\nSurvivor: Frank Buckles, the final World War I veteran, outlived 4.7million other U.S. servicemen before he died at age 110 in March 2011\n\nMr Briant, 103 during his interview, said: 'Such fine, handsome, healthy young men, to be killed on the last night of the war. I cried for their parents.'\n\nReuben Law - 105 at the time of the \ninterview -- said he was apart of a convoy en route to France in 1918 \nwhen a deadly flu epidemic struck.\n\nHe told Mr Rubin: 'I think we were in the \nwater for 21 days... The thing about the trip across was the flu, and there were 91 who died aboard ship.\n\nHe said they converted the dining room of a ship to a hospital, where the sick soldiers had to sleep on tables.\n\nMr Buckles, the final World War II veteran, outlived 4.7million other U.S. \nWorld War I servicemen before he died at age 110 in March 2011.\n\nBut unlike the others, Buckles did not see World War I combat - at least not yet.\n\nIn World War II, Buckles was captured by the Japanese in Manila and was held for three years as a prisoner of war.\n\nHe told Mr Rubin about his dramatic escape when the camp was liberated by U.S. Army paratroopers. He said that he quickly grabbed his rucksack, got dressed and got out just before the burning roof collapsed.\n\nThe Last of the Doughboys, was released last week.\n\n@highlight\n\nInterviews with dozens of the last World War I veterans were conducted by Richard Rubin for his book, The Last of the Doughboys\n\n@highlight\n\nHe spent 10 years conducting interviews and research for the book", "By\nMike Dawes\n\nMichael Wasley sprang one of the Crucible's great upsets as he beat world No 2 Ding Junhui in the first round of the Dafabet World Championship.\n\nIn a midnight finish, Wasley prevailed 10-9 against China's great title hope after a breathtaking and hastily arranged third session.\n\nThey had been forced to go off with Ding lead 9-8 as the afternoon session ran over its allocated time, and an inspired Wasley seized the moment at the climax to the match, levelling with an impeccable 103 break and holding his nerve in an ultra tense 19th frame.\n\nShock: Ding Junhui (left) was beaten by Michael Wasley (right) in the first round at The Crucible\n\nDing had been seeded to meet Ronnie \nO'Sullivan in the semi-finals, but now one of the defending champion's \nmain obstacles has been removed.\n\nHe\n might yet run into 24-year-old Wasley from Gloucester, who belied his \ninexperience and world ranking of 73 to beat a man who has won five \nmajor ranking titles this season, tying a record set by Stephen Hendry \nover two decades ago.\n\nWasley sealed his win on the pink in the decider, and showed his delight as he pumped his fist.\n\nThere\n was another dramatic finale earlier in the evening session as Mark \nSelby edged through to the second round with a nail-biting 10-9 win over\n Michael White.\n\nSelby, who \nfinished runner-up at the Crucible in 2007, led his Welsh opponent 3-0, \n5-1 and 8-4 but White fought back to level 9-9 and take the match to a \ndeciding frame.\n\nNail biter: Mark Selby beat Michael White in a final frame decider at The Crucible\n\nNerve: Selby made a 57 break in the 19th frame to secure a tense victory\n\nIt was Selby\n though who held his nerve at the death, making a break of 57 to take \nthe decider and seal his place in the next round.\n\nFour-time champion John Higgins faces a fight to stay in the tournament as he trails Alan McManus 6-3 after the opening session.\n\nMcManus,\n who had beaten another former champion Mark Williams in the final \nqualifying round, lost the opening frame but came to win the next six in\n a row with commanding breaks of 87 and 74 along the way.\n\nHiggins\n hauled himself back into the contest by winning the last two frames but\n has an uphill task to progress when he continues on Tuesday morning.\n\nJoe Perry won six consecutive frames to come from 6-3 down to beat Joe Burnett 10-7.\n\nBreaks of 87, 55, 70, 51 and finally 81, ensured Perry's passage to the next round.\n\n@highlight\n\nDing Junhui beaten 10-9 by Michael Wasley in first round\n\n@highlight\n\nMark Selby sees off Michael White 10-9 at The Crucible"]
MSE Loss with target embeddings: 0.009147725068032742

---

license: mit

datasets:

• ccdv/cnn_dailymail

language:

• en

base_model:

• facebook/bart-base

pipeline_tag: summarization

---