Department of Justice Appropriations Authorization Act, Fiscal Years 2004 through 2006

Department of Justice Appropriations Authorization Act, Fiscal Years 2004 through 2006 - Authorizes appropriations for FY 2004 through 2006 to carry out the activities of the Department of Justice.

Amends the Omnibus Crime Control and Safe Streets Act of 1968 (Safe Streets Act) to merge the Byrne grant program and the local law enforcement block grant program into an Edward Byrne Memorial Justice Assistance Grant Program.

Authorizes the presentation, on behalf of Congress, of: (1) a bronze medal to the public safety officers in New York, Virginia, and Pennsylvania who lost their lives as a result of responding to the September 11, 2001, terrorist attacks; and (2) a plaque commemorating the service of such officers to their public agencies.

Amends the USA PATRIOT Act to: (1) provide for the establishment and maintenance of a secure telecommunications system for regional information sharing between Federal, State, and local law enforcement agencies; and (2) authorize grants for nonprofit neighborhood and community-based victim service organizations and coalitions to improve outreach and services to crime victims.

Amends the Safe Streets Act to establish within the Office of Justice Programs: (1) an Office of Weed and Seed Strategies to implement strategies to prevent, control, and reduce violent crime, criminal drug-related activity, and gang activity in designated communities; (2) an Office of Audit, Assessment, and Management to carry out and coordinate performance audits of, ensure compliance with, and manage information with respect to, specified Department of Justice grant programs; (3) a Community Capacity Development Office to provide training to participants in such grant programs; and (4) an Office of Applied Law Enforcement Technology to provide leadership and focus to Department grants made for using or improving law enforcement computer systems.

Requires the Attorney General to designate a senior Department official to assume primary responsibility for privacy policy.