aboutsummaryrefslogtreecommitdiff
path: root/gn3
AgeCommit message (Collapse)Author
2021-03-23Convert Path object to a strBonfaceKilz
* gn3/file_utils.py (cache_ipfs_file): Return a str instead of a path object. * tests/unit/test_file_utils.py: Update failing tests.
2021-03-23Update where cached file is storedBonfaceKilz
2021-03-23Use ipfs to get genotype filesBonfaceKilz
2021-03-23Apply auto-pep8 formattingBonfaceKilz
2021-03-23Add function to cache ipfs filesBonfaceKilz
2021-03-23Re-add mypy conf fileBonfaceKilz
Deleted in 56ce88a
2021-03-17gn3: computations: correlations: Apply autopep-8.BonfaceKilz
2021-03-17gn3: file_utils: Apply autopep-8BonfaceKilz
2021-03-16delete unwanted correlation stuff (#5)Alexander Kabui
* delete unwanted correlation stuff * Refactor/clean up correlations (#4) * initial commit for Refactor/clean-up-correlation * add python scipy dependency * initial commit for sample correlation * initial commit for sample correlation endpoint * initial commit for integration and unittest * initial commit for registering correlation blueprint * add and modify unittest and integration tests for correlation * Add compute compute_all_sample_corr method for correlation * add scipy to requirement txt file * add tissue correlation for trait list * add unittest for tissue correlation * add lit correlation for trait list * add unittests for lit correlation for trait list * modify lit correlarion for trait list * add unittests for lit correlation for trait list * add correlation metho in dynamic url * add file format for expected structure input while doing sample correlation * modify input data structure -> add trait id * update tests for sample r correlation * add compute all lit correlation method * add endpoint for computing lit_corr * add unit and integration tests for computing lit corr * add /api/correlation/tissue_corr/{corr_method} endpoint for tissue correlation * add unittest and integration tests for tissue correlation Co-authored-by: BonfaceKilz <bonfacemunyoki@gmail.com> * update guix scm file * fix pylint error for correlations api Co-authored-by: BonfaceKilz <bonfacemunyoki@gmail.com>
2021-03-16Refactor/clean up correlations (#4)Alexander Kabui
* initial commit for Refactor/clean-up-correlation * add python scipy dependency * initial commit for sample correlation * initial commit for sample correlation endpoint * initial commit for integration and unittest * initial commit for registering correlation blueprint * add and modify unittest and integration tests for correlation * Add compute compute_all_sample_corr method for correlation * add scipy to requirement txt file * add tissue correlation for trait list * add unittest for tissue correlation * add lit correlation for trait list * add unittests for lit correlation for trait list * modify lit correlarion for trait list * add unittests for lit correlation for trait list * add correlation metho in dynamic url * add file format for expected structure input while doing sample correlation * modify input data structure -> add trait id * update tests for sample r correlation * add compute all lit correlation method * add endpoint for computing lit_corr * add unit and integration tests for computing lit corr * add /api/correlation/tissue_corr/{corr_method} endpoint for tissue correlation * add unittest and integration tests for tissue correlation Co-authored-by: BonfaceKilz <bonfacemunyoki@gmail.com>
2021-03-15Remove undefined variableBonfaceKilz
2021-03-15Apply pep-8 formattingBonfaceKilz
2021-03-15Delete redundant gn3/config.pyBonfaceKilz
All default confs should go to one place: gn3/setting.py * gn3/app.py: Delete get_config. Apply pep-8 formatting. * gn3/config.py: Delete it. Move conf options to... * gn3/settings.py: ... here.
2021-03-13Correlation api (#2)Alexander Kabui
* add file for correlation api * register initial correlation api * add correlation package * add function for getting page data * delete loading page api * modify code for correlation * add tests folder for correlations * fix error in correlation api * add tests for correlation * add tests for correlation loading data * add module for correlation computations * modify api to return json when computing correlation * add tests for computing correlation * modify code for loading correlation data * modify tests for correlation computation * test loading correlation data using api endpoint * add tests for asserting error in creating Correlation object * add do correlation method * add dummy tests for do_correlation method * delete unused modules * add tests for creating trait and dataset * add intergration test for correlation api * add tests for correlation api * edit docorrelation method * modify integration tests for correlation api * modify tests for show_corr_results * add create dataset function * pep8 formatting and fix return value for api * add more test data for doing correlation * modify tests for correlation * pep8 formatting * add getting formatted corr type method * import json library add process samples method for correlation * fix issue with sample_vals key_error * create utility module for correlation * refactor endpoint for /corr_compute * add test and mocks for compute_correlation function * add compute correlation function and pep8 formatting * move get genofile samplelist to utility module * refactor code for CorrelationResults object * pep8 formatting for module * remove CorrelationResults from Api * add base package initialize data_set module with create_dataset,redis and Dataset_Getter * set dataset_structure if redis is empty * add callable for DatsetType * add set_dataset_key method If name is not in the object's dataset dictionary * add Dataset object and MrnaAssayDataSet * add db_tools * add mysql client * add DatasetGroup object * add species module * get mapping method * import helper functions and new dataset * add connection to db before request * add helper functions * add logger module * add get_group_samplelists module * add logger for debug * add code for adding sample_data * pep8 formatting * Add chunks module * add correlation helper module * add get_sample_r_and_p_values method add get_header_fields function * add generate corr json method * add function to retrieve_trait_info * remove comments and clean up code in show_corr_results * remove comments and clean up code for data_set module * pep8 formatting for helper_functions module * pep8 formatting for trait module * add module for species * add Temp Dataset Object * add Phenotype Dataset * add Genotype Dataset * add rettrieve sample_sample_data method * add webqtlUtil module * add do lit correlation for all traits * add webqtlCaseData:Settings not ported * return the_trait for create trait method * add correlation_test json data * add tests fore show corr results * add dictfier package * add tests for show_corr_results * add assertion for trait_id * refactor code for show_corr_results * add test file for compute_corr intergration tests * add scipy dependency * refactor show_corr_results object add do lit correlation for trait_list * add hmac module * add bunch module:Dictionary using object notation * add correlation functions * add rpy2 dependency * add hmac module * add MrnaAssayTissueData object and get_symbol_values_pairs function * add config module * add get json_results method * pep8 formatting remove comments * add config file * add db package * refactor correlatio compuatation module * add do tissue correlation for trait list * add do lit correlation for all traits * add do tissue correlation for all traits * add do_bicor for bicor method * raise error for when initital start vars is None * add support for both form and json data when for correlation input * remove print statement and pep8 formatting * add default settings file * add tools module for locate_ignore_error * refactor code remove comments for trait module * Add new test data for computing correlation * pep8 formatting and use pickle * refactor function for filtering form/json data * remove unused imports * remove mock functions in correlation_utility module * refactor tests for compute correlation and pep8 formatting * add tests for show_correlation results * modify tests for show_corr_results * add json files for tests * pep8 formatting for show_corr_results * Todo:Lint base files * pylint for intergration tests * add test module for test_corr_helpers * Add test chunk module * lint utility package * refactoring and pep8 formatting * implement simple metric for correlation * add hmac utility file * add correlation prefix * fix merge conflict * minor fixes for endpoints * import:python-scipy,python-sqlalchemy from guix * add python mysqlclient * remove pkg-resources from requirements * add python-rpy3 from guix * refactor code for species module * pep8 formatting and refactor code * add tests for genereating correlation results * lint correlation functions * fix failing tests for show_corr_results * add new correlation test data fix errors * fix issues related to getting group samplelists * refactor intergration tests for correlation * add todo for refactoring_wanted_inputs * replace custom Attribute setter with SimpleNamespace * comparison of sample r correlation results btwn genenenetwork2 and genenetwork3 * delete AttributeSetter * test request for /api/correlation/compute_correlation took 18.55710196495056 Seconds * refactor tests and show_correlation results * remove unneccessary comments and print statements * edit requirement txt file * api/correlation took 114.29814600944519 Seconds for correlation resullts:20000 - corr-type:lit - corr-method:pearson corr-dataset:corr_dataset:HC_M2_0606_P * capture SQL_URI and GENENETWORK FILES path * pep8 formatting edit && remove print statements * delete filter_input function update test and data for correlation * add docstring for required correlation_input * /api/correlation took 12.905632972717285 Seconds * pearson * lit *dataset:HX_M2_0606_P trait_id :1444666 p_range:(lower->-0.60,uppper->0.74) corr_return_results: 100 * update integration and unittest for correlation * add simple markdown docs for correlation * update docs * add tests and catch for invalid correlation_input * minor fix for api * Remove jupyter from deps * guix.scm: Remove duplicate entry * guix.scm: Add extra action items as comments * Trim requirements.txt file Co-authored-by: BonfaceKilz <me@bonfacemunyoki.com>
2021-03-10Rename "covariates" to "covars" in endpoints for consistencyBonfaceKilz
2021-03-10Queue the command only onceBonfaceKilz
2021-03-10Fix k-compute command when "loco" is trueBonfaceKilz
2021-03-10Call Redis hset correctly in the right orderBonfaceKilz
2021-03-10Apply yapf file formatting to fileBonfaceKilz
2021-03-10Add extra endpoint for when TOKEN isn't providedBonfaceKilz
2021-03-10Extract file to the correct locationBonfaceKilz
2021-03-08Remove unused importsBonfaceKilz
2021-03-08Delete "generate_gemma_computation_cmd"BonfaceKilz
2021-03-08Remove "/k-gwa-computation"BonfaceKilz
2021-03-08Add "/k-gwa-compute/covars/loco/<chromosomes>/maf/<maf>/<token>"BonfaceKilz
Reviewed-by: BonfaceKilz <me@bonfacemunyoki.com>
2021-03-08Add "/gemma/k-gwa-compute/loco/<chromosomes>/maf/<maf>/<token>"BonfaceKilz
2021-03-08Add "/k-gwa-compute/covars/<token>"BonfaceKilz
2021-03-08Add "/gemma/k-gwa-compute/<token>"BonfaceKilz
2021-03-08Replace "compute_k_values" with "generate_gemma_cmd"BonfaceKilz
2021-03-08Use new "compute_k_values" procedureBonfaceKilz
2021-03-08Add generic fn for computing k and gwa valuesBonfaceKilz
2021-03-08Apply pep-8 formattingBonfaceKilz
Began using elpy's format code fn
2021-03-08Add new endpointBonfaceKilz
"/gwa-compute/<k_filename>/loco/covariates/maf/<maf>/<token>"
2021-03-08Replace "generate_gemma_computation_cmd" with "compose_gemma_cmd"BonfaceKilz
2021-03-08bug: Put a space between gemma-wrapper argsBonfaceKilz
2021-03-08Add new endpoint: "/gwa-compute/<k_filename>/loco/maf/<maf>/<token>"BonfaceKilz
2021-03-08Add new endpoint: "/gwa-compute/covars/<k_filename>/<token>"BonfaceKilz
2021-03-08Add new endpoint: "/gwa-compute/<k_filename>/<token>"BonfaceKilz
2021-03-08Add new endpoint: "/gemma/k-compute/loco/<chromosomes>/<token>"BonfaceKilz
2021-03-08Prepend all endpoints with "api"BonfaceKilz
2021-03-08Add new endpoint: "/gemma/k-compute/<token>"BonfaceKilz
* gn3/api/gemma.py (compute_k): New function. * tests/integration/test_gemma.py (tesk_k_compute): New test case.
2021-03-08Create a more generic procedure for getting hash values of filesBonfaceKilz
* gn3/file_utils.py (get_hash_of_values): New procedure. (get_dir_hash): Use more generic "get_hash_of_values" to compute the hash of a directory.
2021-03-08Replace APP_DEFAULTS dict with actual conf paramsBonfaceKilz
2021-03-08Delete "lookup_file" procedureBonfaceKilz
2021-03-08Use new extract_uploaded_file fn when uploading metadataBonfaceKilz
* gn3/api/general.py (upload_metadata): Update docstrings and update the use of "extract_uploaded_file" fn.
2021-03-08Extract files to "/TMPDIR/TOKEN"BonfaceKilz
TOKEN is the user token * gn3/file_utils.py (extract_uploaded_file): Add extra param "token". If a token is empty, create a new directory based off that token. * tests/unit/test_file_utils.py: Update failing tests.
2021-03-08Move "generate_random_n_string" to file_utilsBonfaceKilz
* gn3/computations/gemma.py (generaten_random_n_string): Move to... * gn3/file_utils.py: ... here.
2021-03-08Fix failing testsBonfaceKilz
2021-03-08gn3: commands: Update docstringBonfaceKilz
2021-03-08Add extra endpoint for checking the status of a commandBonfaceKilz
generated by cgit v1.2.3 (git 2.44.0) at 2024-11-23 16:38:00 +0000