NEWS


NMdata 0.1.8

New features

Bugfixes

Other improvements

NMdata 0.1.7 (2024-08-26)

New features

Bugfixes

NMdata 0.1.6 (2024-04-23)

New features

Bugfixes

NMdata 0.1.5 (2024-02-21)

New features

NMdata 0.1.4 (2024-01-09)

New functions

New features

Bugfixes

NMdata 0.1.3 (2023-11-11)

NMdata 0.1.2 (2023-10-19)

New features

Other improvements

NMdata 0.1.1 (2023-09-07)

New features

Other improvements

NMdata 0.1.0 (2023-07-07)

New features

Other improvements

NMdata 0.0.17 (2023-05-02)

This release provides a few bugfixes, nothing major.

New features

Bugfixes

Other improvements

NMdata 0.0.16 (2023-03-26)

New features

Bugfixes

NMcheckData() did not check columns listed in cols.num for NA elements. Now it does.

NMcheckData now only checks col.dv to be non-NA for col.mdv==0 if col.mdv is present.

NMscanInput() would fail if there was no column called ID in the dataset on file. This has been fixed to support cases where renaming or a pseudonym is being used to generate an ID column in $INPUT.

NMdata 0.0.15 (2022-12-01)

This update is of no difference to users. A technicality has been chaned to ensure consistent test results once data.table 1.14.7 is

NMdata 0.0.14 (2022-11-16)

New features

Bugfixes

Other improvements

NMdata 0.0.13 (2022-09-08)

New functions

New data

Bugfixes

NMdata 0.0.12 (2022-06-06)

Bugfixes

Minor changes

NMdata 0.0.11 (2022-02-05)

Bugfixes

NMdata 0.0.10 (2022-01-06)

New functions

Function improvements

Bugfixes

NMdata 0.0.9 (2021-08-09)

The only change from 0.0.8 is a patch provided by Matt Dowle ensuring that tests pass after the release of data.table v1.14.2.

NMdata 0.0.8 (2021-07-09)

NMdata 0.0.7.2

NMreadCsv, NMscanInput, and NMscanData take argument args.fread. The contents of this list are passed as arguments to fread when reading csv files. This should only be needed in rare cases but offers full flexibility to match structure of csv files. Default contents of args.fread can be controlled using NMdataConf.

NMwriteData updated with more concise message.

NMreadSection now returns all sections if argument section is missing or equals NULL or ".".

NMinfo is a new function that provides meta data, processed by as.fun.

If merge.by.row=TRUE, NMscanData now checks if col.row seems to be changed in the Nonmem code. If that is the case, an error is returned.

save argument added to flagsCount function to align with other functions.

NMwriteData now writes meta data to a txt file when writing csv file. NMreadCsv looks for this info and attaches it if found.

NMwriteData takes the argument args.fwrite - a list of arguments passed to fwrite. This is aligned with args.fread used by NMreadCsv. Defaults can be configured using NMdataConf.

Improved and shortened text to console from NMscanData (print.summary_NMdata).

mergeCheck will now throw an explained error if argument df1 has zero rows.

Bugfixes

NMdata 0.0.7.1

compareCols generalized to the single data set case.

mergeCheck has improved warnings when checks fail. This should in most cases provide information for the user to get a good idea what needs to be resolved for the merge to work as expected.

Support for pseudonyms when translating input data column names based on nonmem control stream. Now by default, the column will be returned (doubled) with both pseudonyms as column names.

new function - fnExtension is a simple function to replace the extension of a file name (say from file.mod to file.lst)

new function - dims is a simple function that returns a table of the dimensions of multiple data sets. It is used by multiple other functions in the package and may be useful on its own. However, compareCols reports this information too (by calling dims).

NMscanData now has an argument, translate.input, which can be used to skip the translation of column names according to $DATA in the listing file. This can be necessary if input data has changed and hence $DATA is outdated since last model run.

flagsCount now reports cumulative counts of discards too.

Bugfixes

NMdata 0.0.7

This is a major upgrade from 0.0.6.6 featuring many improvements and bug fixes. Everyone is strongly encouraged to upgrade.

The choice between data combination methods in NMscanData is now done in one argument, called merge.by.row. Before the method was decided based on values of two arguments, cbind.by.filters and col.row. A default value for col.row can now be set using NMdataConf and will not affect the data combination method.

Other arguments which default values can now be modified using NMdataConf are: merge.by.row, col.flagn, col.flagc, use.input, recover.rows, col.model, modelname, file.mod, and check.time, quiet, use.rds.

The tools to assign and count exclusion flags, flagsAssign and flagsCount, have been improved. They now support working on a subset of data (say samples only), and the order (increasing/decreasing) of the exclusion flags is optional. The printing of the count of exclusion flags has been improved.

NMgetSection and NMwriteSection are new functions that can be used to extract sections from and write sections to Nonmem control streams. NMwriteData now returns a list of sections that can be passed directly to NMwriteSection, in order to update control streams to read the updated data file correctly.

compareCols is a very useful new data creation tool. See the difference between presence and classes of columns in data sets. This is useful before rbind'ing or merging - or maybe when those throw an error, and you want to figure out why.

renameByContents is a function that can rename columns which contents match a given criterion. In combination with the provided NMisNumeric, this can be used to rename (say to lowercase) columns that Nonmem cannot interpret (as numeric).

mergeCheck now informs about common column names that are not used to merge by. These will create new column names, and it's often not intended. An argument has been added (ncols.expected) to check the number of columns added to df1 against expectation.

egdt is a new function for expanding grids of data.tables. This is quite technical, and it fills a whole when constructing data with data.tables. It mimics the behavior of merge.data.frame on objects with no common columns.

Bugfixes related to

NMdata 0.0.6.6

Central configuration mechanism implemented. The configuration function to use is NMdataConf. You can configure several options, corresponding to default values of arguments to different functions in the package. This is very useful if you want to change the directory and file naming structure, or if you want to change default column names.

The exclusion flag functions flagsAssign and flagsCount have been generalized to use customizable column names for the numerical and character flags. The default can be configured using NMdataConf.

NMdata 0.0.6.4

If all common column names two data objects to merge are not used for merging (by), new column names are created by merge. The behavior of mergeCheck can now be controlled in case this happens. This is especially useful when using mergeCheck in programming.

A shortcut to system.file(...,package="NMdata") has been removed. The function was called NMdata_filepath and is no longer available. Use system.file instead.

NMdata 0.0.6.3

Meta information added about the input data.

NMdata 0.0.6.2

A summary function is provided for NMdata objects. There is a print function for the summary too. This is printed automatically by NMdata unless quiet=TRUE.

A lot of meta information has been added in an attribute to NMdata objects. This will help the user to understand and automatically document what has been read.

The argument to NMscanData previously called name has been renamed to modelname and generalized to take a function that derives the name from the file path. Also an general option "NMdata.modelname" has been added, so the default behavior can be configured.

NMdata 0.0.6.1

The default class to generate is now data.frame rather than data.table. If you want to work with data.tables, do options(NMdata.as.fun="none")

NMdata 0.0.6

General support for conversion of output to user-specified class. Setting the option "NMdata.as.fun" to a conversion function such as as.data.frame or tibble::as_tibble it is possible for the user to work with their preferred data class. An argument, as.fun, can be used for the individual functions too.

The translation from the output control stream file path (.lst in PSN) and the input control stream (.mod in PSN) can now be configured through the option "NM.file.mod". Typically, all the models to be considered in an analysis have been run on the same system, so it makes most sense to define this behavior once and for all for most users.

NMwriteData improved with checks of column names and automated generation of $INPUT and $DATA Nonmem sections.

NMorderColumns simplified, and documentation improved.

Documentation has been upgraded with a pkgdown site.

New vignette on data set creation tools in NMdata.

New FAQ vignette.

Bugfixes

NMtransInput now supports the case where additional unused column names are given in $INPUT than actually found in $DATA. A warning will be given.

NMdata 0.0.5

This release introduces a consistent default NMscanData behavior that will work in most cases and provide the user with information on how to use a more robust approach to merging input and output data.

Naming of a few arguments to NMscanData has been changed from camelCase to lower.case for consistency.

NMscanTables keeps track of LASTONLY and FIRSTLASTONLY. LASTONLY are now treated like FIRSTONLY while FIRSTLASTONLY tables are disregarded (with a warning).

NMdata 0.0.4

The most obvious change since 0.0.3 is that only one data.table is being returned from NMscanData. This is what used to be the row element in the returned objects previously. The main reason for this change is that it makes it easier for users to post-process only one dataset before splitting into different levels of variability. The small cost is that the user will have to run findCovs, or findVars to get the desired level of variability. These functions are however very simple to use and very fast to run.

This release features numerous improvements to especially the NMscanData function. The work is mainly focused around use without a row identifier. Even without a row identifier, NMscanData should now work for the vast majority of models, including merging with input and recovering rows.

An attribute called vars has been added to the NMdata objects coming out of NMscanData. It features a table of the columns in the returned object and information about where they originate from. More work is still to be done on this, but hopefully it is useful already.

NMwriteData: Added support for passing arguments to saveRDS.

Last but far from least is a new vignette on using NMscanData. Check it out with vignette("NMscanData").

NMdata 0.0.2

This release contains bugfixes and experimental support for merging nonmem input and output data without a row identifier.

A clearer cut has been made between the pmxtricks package (version 0.0.10) and NMdata. The packages should not overlap in exported functionality, and they do not depend on each other.