Thread Links Date Links
Thread Prev Thread Next Thread Index Date Prev Date Next Date Index

Re: [802.3_DIALOG] Future 50 Gigabit Ethernet CFI



Paul 

The challenge is with much more ~144 SerDes lanes then ends up with a pacakge approaching 60x60 mm and forced to move from organic to ceramic packages.  See page 5
http://www.ieee802.org/3/bs/public/14_11/ghiasi_3bs_01_1114.pdf

Another challenge is the ASIC power dissipation where higher than 200 W starts requiring non conventional cooling.  Further constrain comes on the line card power dissipation where you ideally want to keep PD <500 W but on very high value system <800 W.   On these system you have NPU, processors, and memory sometimes they dissipate more than few watts.:)   

With on board optics you may be able to double the BW on a conventional aired cooled system, due to other system limitations.   With on board optics then you have to deal with all the serviceability issue and choosing your favorite flavor of SMF PMDs such as PSM4, CWM4, CLR4, Open Optics, Bi-Di, PAM4, etc?  As long as SFP56 and QSFP56 are technically viable it will provide serviceability, flexibility, and Cu support while  doubling the front panel BW.

Thanks,
Ali Ghiasi
Ghiasi Quantum LLC
Office (408)352-5346


On May 8, 2015, at 9:06 AM, Kolesar, Paul <PKOLESAR@xxxxxxxxxxxxx> wrote:

Scott,
Good thoughts on the use of multi-lane optics.  They are a key to front panel density improvements.  But why stop at QSFP densities?  With the MPO-16 and form factors like the CDFP, density can increase another four fold.    
 
Regards,
Paul
 
From: Scott Kipp [mailto:skipp@xxxxxxxxxxx] 
Sent: Friday, May 08, 2015 10:18 AM
To: STDS-802-3-DIALOG@xxxxxxxxxxxxxxxxx
Subject: Re: [802.3_DIALOG] Future 50 Gigabit Ethernet CFI
 
All,
 
I see a different and much more prolific progression for 1RU switches.
 
The switch Vineet mentions is based on a 64-port ASIC while higher density switches are using 128 port ASICs today.  This exceeds the port density of SFP (my first form factor standard that I worked on) and pushes us towards my beloved QSFP family.
 
Here is a progression with 128 Port ASIC in 1RU Switch
Today = 32 x QSFP+ with 10G downlinks and 40G uplinks – End users decide the ratio of up to downlinks with breakout cables.
2015/2016 = 32 x QSFP28 with 10/25G downlinks and 40/100G uplinks.
 
50G era – probably deployed in 2019 = 32 x QSFP56 with 10/25/50G downlinks and 40/100/200G uplinks.  Do you want 1, 2 or 4 lanes at 10,25 or 50G?
 
Future (dream for mid 2020s) = 32 x QSFP100 with 25/50/100G downlinks and 100/200/400G uplinks.  Do you want 1, 2 or 4 lanes 25, 50 or 100G?  Maybe we can still support 10G on each port as well.  This shows the versatility that ASICs will hopefully support and the roadmap that Fibre Channel has supported for years. 
 
You can see a vision for the future in the 2015 Ethernet Roadmap in exquisite detail at www.ethernetalliance.org/roadmap/.  The Ethernet Alliance will be giving out free printed copies of the 18” X24” roadmap in Pittsburgh.  There will also be a special gift related to the roadmap at the social on Tuesday night – don’t miss it.
 
Are we limited to 128 port ASICs?  No.
 
Higher port count ASICs and multi-ASIC configurations are driving COBO and other embedded solutions that will surpass the capability of the venerable QSFP.  Maybe the uQSFP will be useful in matching the needs of these higher port count ASICs.  The future is dense!
 
Kind regards,
Scott
 
 
 
 
 
From: Vineet Salunke (vineets) [mailto:vineets@xxxxxxxxx] 
Sent: Thursday, May 07, 2015 6:49 PM
To: STDS-802-3-DIALOG@xxxxxxxxxxxxxxxxx
Subject: Re: [802.3_DIALOG] Future 50 Gigabit Ethernet CFI
 
These are the port configurations for “1RU fixed switches” (Top of Rack) that will be enabled by 50G / 200G ports.
The uplink / downlink bandwidth ratio is 3:1 or 2:1, depending on 4 versus 6 QSFPs.
Note that this applies to any 1RU box, including Aggregation Switches, Routers (not just Server connections).
 
Today = 48 x SFP 10G downlinks + 6 x QSFP 40G uplinks.
Soon = 48 x SFP 25G downlinks + 6 x QSFP 100G uplinks.
Future = 48 x SFP 50G downlinks + 6 x QSFP 200G uplinks
Future (dream) = 48 x SFP 100G downlinks + 6 x QSFP 400G uplinks
 
--vineet
 
From: Rob (Robert) Stone [mailto:rob.stone@xxxxxxxxxxxx] 
Sent: Thursday, May 07, 2015 5:47 PM
To: Vineet Salunke (vineets); STDS-802-3-DIALOG@xxxxxxxxxxxxxxxxx
Subject: RE: [802.3_DIALOG] Future 50 Gigabit Ethernet CFI
 
I agree there is a lot of merit to standardize 200G as a partner with 50G serial IO and continue the factor of 4 down / uplink – especially given that the SI and module challenges seem relatively do-able.
 
One additional thought – if we agree that 50/200 makes sense, would it follow that 100 / 400 would also pair up? That would enable a two lane twinax DAC server interconnect paired with a 400G uplink. The 400G would be already covered in .bs, and the 100G may “come for free” with 200G, just less lanes?
 
So it would seem in my opinion that 50, 100 and 200G based on 50G IO would be relatively mainstream PMDs, and would merit discussion for inclusion (at the risk of project overload!).
 
Thanks

Rob
 
 
From: Vineet Salunke (vineets) [mailto:vineets@xxxxxxxxx] 
Sent: Thursday, May 07, 2015 4:03 PM
To: Chris Cole; 
Cc: Vineet Salunke (vineets)
Subject: RE: [802.3_DIALOG] Future 50 Gigabit Ethernet CFI
 
And 50G SFP / 200G QSFP for Ethernet will have nice alignment and re-use with Fiber Channel roadmap for 64GFC SFP / 256GFC QSFP ….
 
--vineet
 
From: Chris Cole [mailto:chris.cole@xxxxxxxxxxx] 
Sent: Thursday, May 07, 2015 3:33 PM
To: STDS-802-3-DIALOG@xxxxxxxxxxxxxxxxx
Subject: Re: [802.3_DIALOG] Future 50 Gigabit Ethernet CFI
 
Ali,
 
These are great examples.
 
Standardizing 50G and 200G PMDs will continue the successful progression of single and quad channel devices for high volume datacenter applications.
 
Per lane rate
Gb/s
Single lane rate
Form factor
Quad lane rate
Form factor
Quad data rate
Gb/s
10
SFP+
QSFP+
40
25
SFP28
QSFP28
100
50
SFP56
QSFP56
200
 
Another great example of multi-lane 50G technology application was cited in your SMF Ad Hoc presentation survey of relevant papers from OFC 2015.
 
 
In this post-deadline paper Cisco authors presented a 2x50G PAM-4 (optical) 100Gb/s QSFP28 transceiver using Cisco 50G PAM-4 optics and Broadcom 50G PAM-4 (line side) PHY.  Measurement results were for 10km SMF and 100m OM3.
 
Chris
 
From: Ali Ghiasi [mailto:aghiasi@xxxxxxxxx] 
Sent: Thursday, May 07, 2015 2:45 PM
To: STDS-802-3-DIALOG@xxxxxxxxxxxxxxxxx
Subject: Re: [802.3_DIALOG] Future 50 Gigabit Ethernet CFI
 
John
 
I see opportunity for full spectrum of PMDs for both 50 GbE and 200 GbE including popular break out option with combination of QSFP56 and SFP56:
            - CR
            - KR
            - MMF
            - SMF PSM4/FR/LR
 
Thanks,
Ali Ghiasi
Ghiasi Quantum LLC
Office (408)352-5346

<image001.png>
 
On May 7, 2015, at 1:31 PM, John DAmbrosia <John_DAmbrosia@xxxxxxxx> wrote:

 

Mark,
I would like to request clarification of your stated intent below.  You state the CFI will focus on single lane 50Gb/s Ethernet.  While I realize you are initiating this effort – in my opinion the discussion that I am seeing happen is essentially “n” by 50Gb/s per lane with 50GbE and 200GbE being discussed. 
 
As this is a consensus building process, will you be allowing interested parties to bring presentations forward to state justification for why 200GbE should also be considered?  Based on my conversations, I believe there are a number of individuals who would like these topics discussed together.
 
Could you also provide any more insight into what you are proposing for single lane 50GbE?  Will this be like the .3by project – Backplane, Cu Twin-as, and MMF?  Or is that a TBD in your mind that you hope to address during consensus building?
 
Thanks in advance for your answers.
 
Regards,
 
John D’Ambrosia
 
From: Mark Nowell (mnowell) [mailto:mnowell@xxxxxxxxx] 
Sent: Thursday, May 07, 2015 10:53 AM
To: STDS-802-3-DIALOG@xxxxxxxxxxxxxxxxx
Subject: [802.3_DIALOG] Future 50 Gigabit Ethernet CFI
 
Dear Colleagues:
 
I wanted to let everyone know that a number of people have started preliminary discussions that would lead towards having a Call-for-Interest on the topic of single lane 50 Gigabit/s Ethernet at a future plenary meeting of 802.3.  If anyone is interested in helping and contributing, please let me know or talk to me In Pittsburgh.  As we get further along, we will be sharing some of the plans and data we are gathering to support the CFI.
 
Regards, 
Mark