How to identify and delete empty datasets in an elegant manner

sas

    Sponsored Links

    Next

  • 1. A q about how to do a hotelling t square test
    Dear all, I could not find a way to do hotelling t square test in SAS. Can anyone help? BR, Minze
  • 2. macro to import spreadsheets from a directory
    I have the following macro which reads all the files from a directory. I would like to feed the file location and name to proc import to create a table from each file. My code is: options symbolgen mprint; %macro getdirlist(file_location); rc=filename("datadir","&file_location"); did=dopen("datadir"); if did > 0 then do; count_of_files=dnum(did); if count_of_files > 0 then do; do i=1 to count_of_files; fileref="&file_location" ||"\"|| dread(did,i); file=dread(did,i); file = reverse(substr(left(reverse(file)),5)); rc=filename("filenm", fileref); fid=fopen("filenm"); call symput('fileloc',trim(left(fileref))); call symput('tablenm',trim(left(file))); output; end; end; end; rc=dclose(did); drop rc did count_of_files i fid; %mend; The problem I am having is how to get proc import in a loop to accept the FILENM and TABLENM macro variables. So it would be this code for each file in the directory: PROC IMPORT OUT= WORK..&filenm DATAFILE= "&filenm" DBMS=EXCEL2000 REPLACE; GETNAMES=YES; RUN;
  • 3. Arithmetic Operations in Arrays
    Hi , I have a similar problem as I posed last time. I have some variables like : Gat32_1 Gat32_2 Gat32_3 Gat32_4 Gat32_5 Gat8pk_1 Gat64_1 Gat64_2 Gat64_3 Gat8pk_2 Gat8pk_3 Gat8pk_4 Gat8pk_5 Gat8pk_6 Gat8pk_7 Pow32_1 Pow32_2 Pow32_3 Pow32_4 Pow32_5 TGAT_1 TGAT_2 TGAT_3 TGAT_4 TGAT_5 and I wanted to do some arithmetic opreation on these variables. I wrote a code as below: %macro mac9; %let pid1 = 2; %let pid2 = 3; %let pid3 = 4; %let pid4 = 22; %let pid5 = 40; data fin_numdisp; set fin_numdisp; array dis1(*) GAT32:; array dis2(*) GAT8pk:; array dis3(*) GAT64:; array dis4(*) POW:; array dis5(*) TGAT:; %do i = 1 %to 5; %do j = 1 %to DIM(dis1); if &&dis&i(&j) = &&dis&i(&j) * (BNDN&&pid&i + BNDP&&pid&i); %end; %end; run; %mend mac9; %mac9; But I am getting an error as ERROR: Required operator not found in expression: DIM(dis&i) ERROR: The %TO value of the %DO J loop is invalid. ERROR: The macro MAC9 will stop executing. Kindly suggest a way.
  • 4. SAS Explorer
    Hello, I am trying to view in SAS Explorer some SQL tables via an ODBC connection (libname test odbc dsn=test schema=dbo;). Unfortunately, when I try to open those SQL tables that have a "#" included in the table name I get an error stating that the table does not have a valid SAS name. Does anyone have any suggestions on how to get around this without renaming the actual SQL table itself? Any help would be appreciated. Thanks.

How to identify and delete empty datasets in an elegant manner

Postby Shelley.Baxter » Sun, 26 Mar 2006 02:58:01 GMT

Would this be a proc sql approach with the vtable?

Shelley S. Baxter, Ph.D.
Boeing Corp.
            509-637-4500

Re: How to identify and delete empty datasets in an elegant manner

Postby Jiann-Shiun.Huang » Sun, 26 Mar 2006 03:47:32 GMT

Shelley:

  If your datasets are "ORDINARY DATASET" as mentioned in Jack's paper,
then the following code should work for you.  You need to change
LibraryName to your libname without any quotation.

%let MyLib=%upcase(LibraryName);  /*Without any quote*/
proc sql noprint;
  select memname into :NameList separated by ' '
  from sashelp.vtable
  where libname="&MyLib" and nobs eq 0;
quit;

%put &NameList;

%macro droptbl(lib,nooblist);
  %let filecnt=%eval(%sysfunc(count(&nooblist,%str( )))+1);
  %put &filecnt;
  proc sql;
    %do i=1 %to &filecnt;
          %let dataset=%scan(&nooblist,&i);
          drop table &lib..&dataset;
    %end;
  quit;
%mend droptbl;

%droptbl(&MyLib,&NameList)
run;


J S Huang
1-515-557-3987
fax 1-515-557-2422

That's would I would do, if I knew the provenance of the data sets.
I'd probably use dictionary.tables rather than sashelp.vtable - it's
supposedly more efficient.

You do have to know how your data sets were created and modified -
there are some circumstances under which the observation count in
dictionary.tables will not be correct.  See my paper How Many
Observations Are In My Dataset?" at

< http://www.**--****.com/ ;.








---
Jack Hamilton
Sacramento, California

Re: How to identify and delete empty datasets in an elegant manner

Postby joewhitehurst » Sun, 26 Mar 2006 04:45:24 GMT

Or, you might consider the folllowing simple SAS Component Language program.

length memname $32;
init:
  submit continue;
     proc contents data=newtable._all_ dir noprint out=lib_contents;
     run;
  endsubmit;
lib_contents_dsid=open('lib_contents','i');
do until(fetch(lib_contents_dsid)^=0);
   temp_dsid=open('sashelp.'||memname,'v');
   if attrn(temp_dsid,'nobs')=0 then do;
      close_rc=close(temp_dsid);
      delete_rc=delete('newtable.'||memname);
  end;
end;
close_rc=close(lib_contents_dsid);
return;



Re: How to identify and delete empty datasets in an elegant manner

Postby shiling99 » Sun, 26 Mar 2006 04:48:52 GMT

You may modify the SQL below to achieve your needs.
HTH

1    data;
2    stop;
3    run;

NOTE: The data set WORK.DATA1 has 0 observations and 0 variables.
NOTE: DATA statement used (Total process time):
      real time           0.14 seconds
      cpu time            0.00 seconds


4    data;
5    stop;
6    run;

NOTE: The data set WORK.DATA2 has 0 observations and 0 variables.
NOTE: DATA statement used (Total process time):
      real time           0.03 seconds
      cpu time            0.00 seconds


7    data;
8    stop;
9    run;

NOTE: The data set WORK.DATA3 has 0 observations and 0 variables.
NOTE: DATA statement used (Total process time):
      real time           0.01 seconds
      cpu time            0.00 seconds


10
11   proc sql noprint;
12     select 'drop table '||compress(libname)||'.'||memname into:
dropstmt separated by ';'
13     from sashelp.vtable
14     where nobs=0 and memtype='DATA' and libname in ('WORK');
15     ;
16     &dropstmt
17     ;
NOTE: Table WORK.DATA1 has been dropped.
NOTE: Table WORK.DATA2 has been dropped.
NOTE: Table WORK.DATA3 has been dropped.
18   quit;
NOTE: PROCEDURE SQL used (Total process time):
      real time           0.07 seconds
      cpu time            0.01 seconds


19
20   %put >>>"&dropstmt"<<<;







Re: How to identify and delete empty datasets in an elegant manner

Postby RandyHerbison » Sun, 26 Mar 2006 07:15:46 GMT

entry libname :input :char;

dcl num rc;

init:
dsid=open('sashelp.vtable(where=(libname=upcase("' || libname || '") and
nobs=0))');
any=attrn(dsid,'ANY');
if any then do;
  do until(fetch(dsid)^=0);
    rc=delete('work.'||getvarc(dsid,varnum(dsid,'MEMNAME')));
  end;
end;
dsid=close(dsid);
return;

-----Original Message-----
From:  XXXX@XXXXX.COM  [mailto: XXXX@XXXXX.COM ]
On Behalf Of  XXXX@XXXXX.COM 
Sent: Friday, March 24, 2006 2:45 PM
To: Jiann-Shiun Huang;  XXXX@XXXXX.COM 
Subject: Re: Re: How to identify and delete empty datasets in an elegant
manner


Or, you might consider the folllowing simple SAS Component Language
program.

length memname $32;
init:
  submit continue;
     proc contents data=newtable._all_ dir noprint out=lib_contents;
     run;
  endsubmit;
lib_contents_dsid=open('lib_contents','i');
do until(fetch(lib_contents_dsid)^=0);
   temp_dsid=open('sashelp.'||memname,'v');
   if attrn(temp_dsid,'nobs')=0 then do;
      close_rc=close(temp_dsid);
      delete_rc=delete('newtable.'||memname);
  end;
end;
close_rc=close(lib_contents_dsid);
return;



Re: How to identify and delete empty datasets in an elegant manner

Postby joewhitehurst » Sun, 26 Mar 2006 07:24:35 GMT

andy,

Nice work. I noticed that my solution would not have worked because I left out a call set statement, so values of memname on the contents dataset would never have been moved into the SCL nonwindow variable of the same name causing the delete function to fail.

Joe

Re: How to identify and delete empty datasets in an elegant manner

Postby Shelley.Baxter » Sun, 26 Mar 2006 11:44:15 GMT





Thank you for the help. I can see that the Shiling approach is the most
compact and elegant. I will keep the dictionary vs vtable distinction in
mind. I have thought about learning SCL since I won a book about it as a
door prize and keep finding myself in that documentation area and that's
the only way something can be done. But if I bunny trail off on that now I
will never get the project done!

Re: How to identify and delete empty datasets in an elegant manner

Postby BenDray » Tue, 28 Mar 2006 19:05:41 GMT

Hi Joe/Randy,

I like the look of the SCL program above - however I've never used SCL
and just tried to copy/paste into a SAS session but it's not working.
Can you tell me how to run this SCL code please??

Many thanks!!

Ben


Re: How to identify and delete empty datasets in an elegant manner

Postby joewhitehurst » Wed, 29 Mar 2006 02:29:47 GMT

Ben,

You must place the code in a SAS Catalog as member type SCL and compile it
before you can execute it.

Joe

-----Original Message-----
From: SAS(r) Discussion [mailto: XXXX@XXXXX.COM ] On Behalf Of BenDray
Sent: Monday, March 27, 2006 5:06 AM
To:  XXXX@XXXXX.COM 
Subject: Re: How to identify and delete empty datasets in an elegant manner

Hi Joe/Randy,

I like the look of the SCL program above - however I've never used SCL
and just tried to copy/paste into a SAS session but it's not working.
Can you tell me how to run this SCL code please??

Many thanks!!

Ben

Similar Threads:

1.How to identify and delete empty datasets in an elegant

2.FW: How to identify and delete empty datasets in an elegant

3.FW: How to identify and delete empty datasets in an

4.deleting empty files in a catalog

Hi,
I am planning to make a macro that has a catalog name as parameter and 
delete all empty files in that catalog.

%macro delete_empty_files(catalog);
???
%mend;

Has anyone made something like that before and can share it with me ? I am 
using Windows XP if it matters.

Regards, Rune




5.Deleting empty columns

I have datasets with 50+ variables. However not all of the columns are
being used. What would be the most efficient way to delete all columns
that are completely empty?

Thanks,
Gerrit

6. Why doesn't this macro delete the empty dataset?

7. identifying two different datasets

8. Identifying observations not in other Datasets



Return to sas

 

Who is online

Users browsing this forum: No registered users and 66 guest