Destination XL (DXLG) 10-Q 2004 Q3 Quarterly report

Exhibit 32.2

CERTIFICATION PURSUANT TO

18 U.S.C. SECTION 1350,

AS ADOPTED PURSUANT TO

SECTION 906 OF THE SARBANES-OXLEY ACT OF 2002

In connection with the Quarterly Report on Form 10-Q of Casual Male Retail Group, Inc. (the “Company”) for the period ended November 1, 2003, as filed with the Securities and Exchange Commission on the date hereof (the “Report”), I, Dennis R. Hernreich, Chief Financial Officer of the Company, certify pursuant to 18 U.S.C. § 1350, as adopted pursuant to § 906 of the Sarbanes-Oxley Act of 2002, that:

(1) The Report fully complies with the requirements of section 13(a) or 15(d) of the Securities Exchange Act of 1934; and

(2) The information contained in the Report fairly presents, in all material respects, the financial condition and results of operations of the Company.

A signed original of this written statement required by Section 906 has been provided to the Company and will be retained by the Company and furnished to the Securities and Exchange Commission or its staff upon request.

/s/ DENNIS R. HERNREICH

Dennis R. Hernreich

Chief Financial Officer

December 8, 2003